Apr 29 06:31:46 devstack cinder-volume[75455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75455) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 06:31:46 devstack cinder-volume[75455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75455) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 06:31:46 devstack cinder-volume[75455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75455) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 06:31:47 devstack cinder-volume[75455]: INFO dbcounter [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Registered counter for database cinder Apr 29 06:31:47 devstack cinder-volume[75455]: DEBUG oslo_db.sqlalchemy.engines [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75455) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 06:31:47 devstack cinder-volume[75455]: DEBUG dbcounter [-] [75455] Writer thread running {{(pid=75455) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 06:31:47 devstack cinder-volume[75455]: INFO cinder.rpc [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 06:31:47 devstack cinder-volume[75455]: INFO cinder.rpc [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 06:31:47 devstack cinder-volume[75455]: DEBUG oslo_db.sqlalchemy.engines [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75455) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 06:31:47 devstack cinder-volume[75455]: INFO cinder.volume.manager [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Determined volume DB was empty at startup. Apr 29 06:31:47 devstack cinder-volume[75455]: DEBUG cinder.volume.manager [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75455) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 06:31:47 devstack cinder-volume[75455]: INFO cinder.volume.manager [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 29 06:31:47 devstack cinder-volume[75455]: WARNING stevedore.named [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 06:31:47 devstack cinder-volume[75455]: WARNING castellan.key_manager [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 06:31:47 devstack cinder-volume[75455]: WARNING cinder.keymgr.conf_key_mgr [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 06:31:47 devstack cinder-volume[75455]: DEBUG cinder.volume.drivers.lvm [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75455) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_concurrency.processutils [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75455) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_concurrency.processutils [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] CMD "cinder-rtstool verify" returned: 0 in 0.430s {{(pid=75455) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_db.sqlalchemy.engines [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75455) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 06:31:48 devstack cinder-volume[75455]: INFO cinder.rpc [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 29 06:31:48 devstack cinder-volume[75455]: INFO cinder.rpc [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 29 06:31:48 devstack cinder-volume[75455]: WARNING stevedore.named [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 06:31:48 devstack cinder-volume[75455]: WARNING castellan.key_manager [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 06:31:48 devstack cinder-volume[75455]: INFO cinder.volume.manager [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_db.sqlalchemy.engines [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75455) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 06:31:48 devstack cinder-volume[75455]: INFO oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Starting 1 workers Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Started child 75624 {{(pid=75455) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Full set of CONF: {{(pid=75455) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] ******************************************************************************** {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Configuration options gathered from: {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] ================================================================================ {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] allow_availability_zone_fallback = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] allow_compression_on_image_upload = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] allowed_direct_url_schemes = [] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] api_rate_limit = True {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75624]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] auth_strategy = keystone {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] az_cache_duration = 3600 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_availability_zone = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_host = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_name = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_stats_polling_interval = 60 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backup_api_class = cinder.backup.api.API {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backup_name_template = backup-%s {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backup_use_same_host = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backup_use_temp_snapshot = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] chap_password = **** {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] chap_username = {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cinder_internal_tenant_project_id = c8d5e4874fce4f87b9bea9898af9a715 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cinder_internal_tenant_user_id = ca6629b861784330bc5d161a5774d9a1 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cloned_volume_same_az = True {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cluster = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] compression_format = gzip {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] compute_api_class = cinder.compute.nova.API {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] config_dir = [] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] config_source = [] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] control_exchange = openstack {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] debug = True {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] default_availability_zone = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] default_group_type = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] default_volume_type = lvmdriver-1 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] disk_geometry = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] driver_client_cert = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] driver_client_cert_key = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] driver_data_namespace = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] driver_ssl_cert_path = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] driver_ssl_cert_verify = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] driver_use_ssl = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] enable_force_upload = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] enable_new_services = True {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] enable_unsupported_driver = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] enabled_backends = ['lvmdriver-1'] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] enforce_multipath_for_image_xfer = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] filter_function = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] glance_api_insecure = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] glance_api_servers = ['http://192.168.122.96/image'] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] glance_api_ssl_compression = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] glance_ca_certificates_file = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] glance_catalog_info = image:glance:publicURL {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] glance_certfile = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] glance_keyfile = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] glance_num_retries = 3 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] glance_request_timeout = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] goodness_function = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] graceful_shutdown_timeout = 5 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] group_api_class = cinder.group.api.API {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] host = devstack {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] image_compress_on_upload = True {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] image_conversion_address_space_limit = 1 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] image_conversion_cpu_limit = 60 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] image_conversion_disable = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] image_upload_use_cinder_backend = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] image_upload_use_internal_tenant = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] image_volume_cache_enabled = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] image_volume_cache_max_count = 0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] image_volume_cache_max_size_gb = 0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] init_host_max_objects_retrieval = 0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] instance_format = [instance: %(uuid)s] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] iscsi_target_flags = {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] iscsi_write_cache = on {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] iser_helper = tgtadm {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] iser_ip_address = 192.168.122.96 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] iser_port = 3260 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] log_color = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] log_config_append = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] log_dir = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] log_file = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] log_options = True {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] log_rotate_interval = 1 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] log_rotate_interval_type = days {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] log_rotation_type = none {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] max_age = 0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] max_logfile_count = 30 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] max_logfile_size_mb = 200 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] max_over_subscription_ratio = 20.0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] message_reap_interval = 86400 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] message_ttl = 2592000 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] migration_create_volume_timeout_secs = 300 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] monkey_patch = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] monkey_patch_modules = [] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] my_ip = 192.168.122.96 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] no_snapshot_gb_quota = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] num_iser_scan_tries = 3 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] num_shell_tries = 3 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] num_volume_device_scan_tries = 3 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] nvmeof_conn_info_version = 1 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] nvmet_ns_id = 10 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] nvmet_port_id = 1 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] osapi_max_limit = 1000 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack sudo[75628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 29 06:31:48 devstack cinder-volume[75624]: INFO cinder.volume.manager [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 29 06:31:48 devstack sudo[75628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] osapi_volume_ext_list = [] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] osapi_volume_listen = 0.0.0.0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] osapi_volume_listen_port = 8776 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] osapi_volume_use_ssl = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] osapi_volume_workers = 2 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] per_volume_size_limit = -1 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] periodic_fuzzy_delay = 60 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] periodic_interval = 60 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] project_id_regex = [0-9a-f\-]+ {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] public_endpoint = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] publish_errors = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] quota_backup_gigabytes = 1000 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] quota_backups = 10 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] quota_gigabytes = 1000 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] quota_groups = 10 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] quota_snapshots = 10 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] quota_volumes = 10 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] rate_limit_burst = 0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] rate_limit_except_level = CRITICAL {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] rate_limit_interval = 0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] reinit_driver_count = 3 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] replication_device = **** {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] report_discard_supported = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] report_interval = 120 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] reservation_clean_interval = 86400 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] reservation_expire = 86400 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] reserved_image_namespaces = [] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] reserved_percentage = 0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] rpc_response_timeout = 120 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] run_external_periodic_tasks = True {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] scst_target_driver = iscsi {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] scst_target_iqn_name = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] service_down_time = 720 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] shell_completion = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] snapshot_name_template = snapshot-%s {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] snapshot_same_host = True {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] split_loggers = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] state_path = /opt/stack/data/cinder {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] storage_availability_zone = nova {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] storage_protocol = iSCSI {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] syslog_log_facility = LOG_USER {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] target_helper = lioadm {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] target_ip_address = 192.168.122.96 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] target_port = 3260 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] target_protocol = iscsi {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] target_secondary_ip_addresses = [] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] trace_flags = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] transfer_api_class = cinder.transfer.api.API {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] transport_url = **** {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] until_refresh = 0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] use_chap_auth = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] use_default_quota_class = True {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] use_journal = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] use_json = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] use_multipath_for_image_xfer = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] use_stderr = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] use_syslog = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] verify_glance_signatures = enabled {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] volume_api_class = cinder.volume.api.API {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] volume_backend_name = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] volume_clear = zero {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] volume_clear_ionice = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] volume_clear_size = 0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] volume_copy_bps_limit = 0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] volume_dd_blocksize = 1M {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] volume_name_template = volume-%s {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] volume_service_inithost_offload = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] volume_usage_audit_period = month {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] zoning_mode = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_concurrency.disable_process_locking = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.admin_password = **** {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.admin_token = **** {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.admin_user = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.auth_admin_prefix = {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.auth_port = 35357 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.auth_protocol = https {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.auth_section = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.auth_type = password {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.auth_uri = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.auth_version = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.cache = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.certfile = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.delay_auth_decision = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.http_connect_timeout = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.identity_uri = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.include_service_catalog = True {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.insecure = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.interface = public {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.keyfile = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.memcache_password = {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.memcache_username = {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.region_name = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.service_token_roles_required = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.service_type = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.token_cache_time = 300 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.96/identity {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.backend = dogpile.cache.null {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.backend_argument = **** {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.backend_expiration_time = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.config_prefix = cache.oslo {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.debug_cache_backend = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.enable_retry_client = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.enable_socket_keepalive = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.enabled = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.enforce_fips_mode = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.expiration_time = 600 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.hashclient_retry_attempts = 2 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.memcache_dead_retry = 300 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.memcache_pool_maxsize = 10 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.memcache_sasl_enabled = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.password = **** {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.proxies = [] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.redis_db = 0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.redis_sentinel_service_name = mymaster {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.redis_server = localhost:6379 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.retry_attempts = 2 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.retry_delay = 0.0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.socket_keepalive_count = 1 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.socket_keepalive_idle = 1 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.socket_keepalive_interval = 1 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.socket_timeout = 1.0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.tls_allowed_ciphers = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.tls_cafile = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.tls_certfile = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.tls_enabled = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.tls_keyfile = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cache.username = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] coordination.backend_url = **** {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] database.asyncio_connection = **** {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] database.asyncio_slave_connection = **** {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] database.backend = sqlalchemy {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] database.connection = **** {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] database.connection_debug = 0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] database.connection_parameters = {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] database.connection_recycle_time = 3600 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] database.connection_trace = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] database.db_inc_retry_interval = True {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] database.db_max_retries = 20 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] database.db_max_retry_interval = 10 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] database.db_retry_interval = 1 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] database.max_overflow = 50 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] database.max_pool_size = 5 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] database.max_retries = 10 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] database.mysql_wsrep_sync_wait = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] database.pool_timeout = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] database.retry_interval = 10 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] database.slave_connection = **** {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] database.sqlite_synchronous = True {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] database.synchronous_reader = True {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] database.use_db_reconnect = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] profiler.connection_string = messaging:// {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] profiler.enabled = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] profiler.es_doc_type = notification {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] profiler.es_scroll_size = 10000 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] profiler.es_scroll_time = 2m {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] profiler.filter_error_trace = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] profiler.hmac_keys = **** {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] profiler.sentinel_service_name = mymaster {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] profiler.socket_timeout = 0.1 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] profiler.trace_requests = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] profiler.trace_sqlalchemy = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] profiler_jaeger.process_tags = {} {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] profiler_jaeger.service_name_prefix = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] profiler_otlp.service_name_prefix = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_policy.enforce_new_defaults = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: WARNING oslo_config.cfg [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_policy.enforce_scope = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_policy.policy_default_rule = default {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_policy.policy_file = policy.yaml {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_policy.remote_timeout = 60.0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] privsep_osbrick.group = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] privsep_osbrick.helper_command = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] privsep_osbrick.user = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cinder_sys_admin.group = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cinder_sys_admin.helper_command = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] cinder_sys_admin.user = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] service_user.auth_section = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] service_user.auth_type = password {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] service_user.cafile = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] service_user.certfile = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] service_user.collect_timing = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] service_user.insecure = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] service_user.keyfile = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] service_user.send_service_user_token = True {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] service_user.split_loggers = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] service_user.timeout = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] glance.auth_section = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] glance.auth_type = password {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] glance.certfile = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] glance.collect_timing = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] glance.insecure = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] glance.keyfile = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] glance.region_name = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] glance.split_loggers = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] glance.timeout = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.backend_availability_zone = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.chap_password = **** {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.chap_username = {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.disk_geometry = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.driver_client_cert = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.driver_client_cert_key = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.driver_data_namespace = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.driver_use_ssl = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.enable_unsupported_driver = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.extra_capabilities = {} {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.filter_function = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.goodness_function = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.iscsi_target_flags = {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.iscsi_write_cache = on {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.iser_helper = tgtadm {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.iser_ip_address = 192.168.122.96 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.iser_port = 3260 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.lvm_mirrors = 0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.lvm_share_target = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.lvm_type = auto {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.num_shell_tries = 3 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.nvmet_port_id = 1 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.replication_device = **** {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.report_discard_supported = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.reserved_percentage = 0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.scst_target_driver = iscsi {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.scst_target_iqn_name = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.storage_protocol = iSCSI {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.target_helper = tgtadm {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.target_ip_address = 192.168.122.96 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.target_port = 3260 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.target_protocol = iscsi {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.trace_flags = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.unique_fqdn_network = True {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.use_chap_auth = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.volume_backend_name = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.volume_clear = zero {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.volume_clear_ionice = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.volume_clear_size = 0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.volume_group = cinder-volumes {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:48 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_reports.file_event_handler = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_reports.log_dir = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.backend_availability_zone = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.backend_host = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.chap_password = **** {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.chap_username = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.chiscsi_conf = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.disk_geometry = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.driver_client_cert = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.driver_data_namespace = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.driver_use_ssl = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.extra_capabilities = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.filter_function = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.goodness_function = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.iser_helper = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.iser_ip_address = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.iser_port = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.iser_target_prefix = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.lvm_conf_file = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.lvm_mirrors = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.lvm_share_target = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.lvm_type = auto {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.num_shell_tries = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.nvmet_port_id = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.replication_device = **** {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.report_discard_supported = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.reserved_percentage = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.scst_target_driver = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.storage_protocol = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.target_helper = lioadm {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.target_ip_address = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.target_port = 3260 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.target_protocol = iscsi {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.trace_flags = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.use_chap_auth = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.volume_clear = zero {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.volume_clear_size = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] lvmdriver-1.volumes_dir = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.ssl = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.ssl_version = {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_notifications.driver = [] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_notifications.retry = -1 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] oslo_messaging_notifications.transport_url = **** {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] key_manager.fixed_key = **** {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] barbican.barbican_api_version = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] barbican.barbican_endpoint = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] barbican.barbican_endpoint_type = public {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] barbican.barbican_region_name = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] barbican.cafile = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] barbican.certfile = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] barbican.collect_timing = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] barbican.insecure = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] barbican.keyfile = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] barbican.number_of_retries = 60 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] barbican.retry_delay = 1 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] barbican.send_service_user_token = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] barbican.split_loggers = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] barbican.timeout = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] barbican.verify_ssl = True {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] barbican.verify_ssl_path = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] barbican_service_user.auth_section = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] barbican_service_user.auth_type = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] barbican_service_user.cafile = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] barbican_service_user.certfile = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] barbican_service_user.collect_timing = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] barbican_service_user.insecure = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] barbican_service_user.keyfile = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] barbican_service_user.split_loggers = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] barbican_service_user.timeout = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] vault.approle_role_id = **** {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] vault.approle_secret_id = **** {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] vault.kv_mountpoint = secret {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] vault.kv_path = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] vault.kv_version = 2 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] vault.namespace = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] vault.root_token_id = **** {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] vault.ssl_ca_crt_file = None {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] vault.timeout = 60.0 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] vault.use_ssl = False {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:31:49 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] ******************************************************************************** {{(pid=75455) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 06:31:49 devstack sudo[75628]: pam_unix(sudo:session): session closed for user root Apr 29 06:31:49 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.765s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:31:49 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:31:49 devstack sudo[75674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 06:31:49 devstack sudo[75674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:31:50 devstack sudo[75674]: pam_unix(sudo:session): session closed for user root Apr 29 06:31:50 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.607s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:31:50 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 06:31:50 devstack cinder-volume[75624]: INFO cinder.brick.local_dev.lvm [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 29 06:31:50 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:31:50 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:31:50 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:31:50 devstack sudo[75912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 06:31:50 devstack sudo[75912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:31:50 devstack sudo[75912]: pam_unix(sudo:session): session closed for user root Apr 29 06:31:50 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:31:50 devstack cinder-volume[75624]: DEBUG cinder.brick.local_dev.lvm [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75624) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 29 06:31:50 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:31:50 devstack sudo[76116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 06:31:50 devstack sudo[76116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:31:52 devstack sudo[76116]: pam_unix(sudo:session): session closed for user root Apr 29 06:31:52 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.621s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:31:52 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:31:52 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:31:52 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:31:52 devstack sudo[76403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 06:31:52 devstack sudo[76403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:31:53 devstack sudo[76403]: pam_unix(sudo:session): session closed for user root Apr 29 06:31:53 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.664s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:31:53 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:31:53 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:31:53 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:31:53 devstack sudo[76414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 29 06:31:53 devstack sudo[76414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:31:53 devstack sudo[76414]: pam_unix(sudo:session): session closed for user root Apr 29 06:31:53 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.620s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:31:53 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:31:53 devstack sudo[76418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 06:31:53 devstack sudo[76418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:31:54 devstack sudo[76418]: pam_unix(sudo:session): session closed for user root Apr 29 06:31:54 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:31:54 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:31:54 devstack sudo[76424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 06:31:54 devstack sudo[76424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:31:55 devstack sudo[76424]: pam_unix(sudo:session): session closed for user root Apr 29 06:31:55 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.748s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:31:55 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:31:55 devstack sudo[76428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 06:31:55 devstack sudo[76428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:31:55 devstack sudo[76428]: pam_unix(sudo:session): session closed for user root Apr 29 06:31:55 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:31:55 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:31:55 devstack sudo[76433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 06:31:55 devstack sudo[76433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:31:56 devstack sudo[76433]: pam_unix(sudo:session): session closed for user root Apr 29 06:31:56 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.728s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:31:56 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:31:56 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:31:56 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:31:56 devstack sudo[76443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 06:31:56 devstack sudo[76443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:31:57 devstack sudo[76443]: pam_unix(sudo:session): session closed for user root Apr 29 06:31:57 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.669s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:31:57 devstack cinder-volume[75624]: INFO cinder.volume.drivers.lvm [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 29 06:31:57 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:31:57 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:31:57 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:31:57 devstack sudo[76451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 06:31:57 devstack sudo[76451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:31:57 devstack sudo[76451]: pam_unix(sudo:session): session closed for user root Apr 29 06:31:57 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.803s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:31:57 devstack cinder-volume[75624]: DEBUG cinder.volume.drivers.lvm [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Updating volume stats {{(pid=75624) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 06:31:57 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:31:57 devstack sudo[76569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 06:31:57 devstack sudo[76569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:31:58 devstack cinder-volume[75455]: DEBUG dbcounter [-] [75455] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75455) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:31:58 devstack sudo[76569]: pam_unix(sudo:session): session closed for user root Apr 29 06:31:58 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.624s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:31:58 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:31:58 devstack sudo[76622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 06:31:58 devstack sudo[76622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:31:59 devstack sudo[76622]: pam_unix(sudo:session): session closed for user root Apr 29 06:31:59 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.586s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:31:59 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:31:59 devstack sudo[76714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 06:31:59 devstack sudo[76714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:31:59 devstack sudo[76714]: pam_unix(sudo:session): session closed for user root Apr 29 06:31:59 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.610s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:31:59 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:31:59 devstack sudo[76717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 06:31:59 devstack sudo[76717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:32:00 devstack sudo[76717]: pam_unix(sudo:session): session closed for user root Apr 29 06:32:00 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.587s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:32:00 devstack cinder-volume[75624]: INFO cinder.volume.driver [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Driver hasn't implemented _init_vendor_properties() Apr 29 06:32:00 devstack cinder-volume[75624]: DEBUG cinder.volume.driver [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75624) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 06:32:00 devstack cinder-volume[75624]: DEBUG oslo_db.sqlalchemy.engines [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75624) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 06:32:00 devstack cinder-volume[75624]: DEBUG dbcounter [-] [75624] Writer thread running {{(pid=75624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 06:32:00 devstack cinder-volume[75624]: DEBUG cinder.db.sqlalchemy.api [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Building query based on filter {{(pid=75624) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 06:32:00 devstack cinder-volume[75624]: DEBUG cinder.image.image_utils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75624) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 06:32:00 devstack cinder-volume[75624]: INFO cinder.keymgr.migration [None req-ae5a97cf-49ed-48f0-8180-94e3bc9eadad None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 06:32:00 devstack cinder-volume[75624]: DEBUG cinder.volume.drivers.lvm [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Updating volume stats {{(pid=75624) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 06:32:00 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:32:00 devstack sudo[76724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 06:32:00 devstack sudo[76724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:32:01 devstack sudo[76724]: pam_unix(sudo:session): session closed for user root Apr 29 06:32:01 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:32:01 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:32:01 devstack sudo[76727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 06:32:01 devstack sudo[76727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:32:01 devstack sudo[76727]: pam_unix(sudo:session): session closed for user root Apr 29 06:32:01 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.604s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:32:01 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:32:01 devstack sudo[76731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 06:32:01 devstack sudo[76731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:32:02 devstack sudo[76731]: pam_unix(sudo:session): session closed for user root Apr 29 06:32:02 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.623s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:32:02 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:32:02 devstack sudo[76735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 06:32:02 devstack sudo[76735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:32:02 devstack sudo[76735]: pam_unix(sudo:session): session closed for user root Apr 29 06:32:02 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:32:02 devstack cinder-volume[75624]: DEBUG cinder.manager [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Notifying Schedulers of capabilities ... {{(pid=75624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:32:03 devstack cinder-volume[75624]: INFO cinder.volume.manager [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Driver initialization completed successfully. Apr 29 06:32:03 devstack cinder-volume[75624]: INFO cinder.manager [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Initiating service 2 cleanup Apr 29 06:32:03 devstack cinder-volume[75624]: INFO cinder.manager [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Service 2 cleanup completed. Apr 29 06:32:03 devstack cinder-volume[75624]: DEBUG cinder.service [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Creating RPC server for service cinder-volume {{(pid=75624) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 06:32:03 devstack cinder-volume[75624]: DEBUG cinder.service [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75624) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 06:32:03 devstack cinder-volume[75624]: INFO cinder.volume.manager [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 29 06:32:03 devstack cinder-volume[75624]: DEBUG cinder.volume.drivers.lvm [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Updating volume stats {{(pid=75624) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 06:32:03 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:32:03 devstack sudo[76742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 06:32:03 devstack sudo[76742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:32:03 devstack sudo[76742]: pam_unix(sudo:session): session closed for user root Apr 29 06:32:03 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.672s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:32:03 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:32:03 devstack sudo[76746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 06:32:03 devstack sudo[76746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:32:04 devstack sudo[76746]: pam_unix(sudo:session): session closed for user root Apr 29 06:32:04 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:32:04 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:32:04 devstack sudo[76749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 06:32:04 devstack sudo[76749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:32:05 devstack sudo[76749]: pam_unix(sudo:session): session closed for user root Apr 29 06:32:05 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.624s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:32:05 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:32:05 devstack sudo[76806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 06:32:05 devstack sudo[76806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:32:05 devstack sudo[76806]: pam_unix(sudo:session): session closed for user root Apr 29 06:32:05 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.588s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:32:05 devstack cinder-volume[75624]: INFO cinder.volume.manager [None req-ec9cb65e-3395-4ae9-bccb-3d5e4b8f5a30 None None] Driver post RPC initialization completed successfully. Apr 29 06:32:15 devstack cinder-volume[75624]: DEBUG dbcounter [-] [75624] Writing DB stats cinder:SELECT=2 {{(pid=75624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:32:15 devstack cinder-volume[75624]: DEBUG dbcounter [-] [75624] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:33:35 devstack cinder-volume[75624]: DEBUG oslo_service.periodic_task [None req-026f072b-a817-419e-adf4-572c8de9343e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 06:33:35 devstack cinder-volume[75624]: DEBUG cinder.volume.drivers.lvm [None req-026f072b-a817-419e-adf4-572c8de9343e None None] Updating volume stats {{(pid=75624) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 06:33:35 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-026f072b-a817-419e-adf4-572c8de9343e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:33:35 devstack sudo[81534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 06:33:35 devstack sudo[81534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:33:36 devstack sudo[81534]: pam_unix(sudo:session): session closed for user root Apr 29 06:33:36 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-026f072b-a817-419e-adf4-572c8de9343e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.604s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:33:36 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-026f072b-a817-419e-adf4-572c8de9343e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:33:36 devstack sudo[81540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 06:33:36 devstack sudo[81540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:33:36 devstack sudo[81540]: pam_unix(sudo:session): session closed for user root Apr 29 06:33:36 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-026f072b-a817-419e-adf4-572c8de9343e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.584s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:33:36 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-026f072b-a817-419e-adf4-572c8de9343e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:33:36 devstack sudo[81543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 06:33:36 devstack sudo[81543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:33:37 devstack sudo[81543]: pam_unix(sudo:session): session closed for user root Apr 29 06:33:37 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-026f072b-a817-419e-adf4-572c8de9343e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.576s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:33:37 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-026f072b-a817-419e-adf4-572c8de9343e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:33:37 devstack sudo[81546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 06:33:37 devstack sudo[81546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:33:38 devstack sudo[81546]: pam_unix(sudo:session): session closed for user root Apr 29 06:33:38 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-026f072b-a817-419e-adf4-572c8de9343e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.578s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:33:38 devstack cinder-volume[75624]: DEBUG cinder.manager [None req-026f072b-a817-419e-adf4-572c8de9343e None None] Notifying Schedulers of capabilities ... {{(pid=75624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:34:15 devstack cinder-volume[75624]: DEBUG dbcounter [-] [75624] Writing DB stats cinder:SELECT=1 {{(pid=75624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:34:15 devstack cinder-volume[75624]: DEBUG dbcounter [-] [75624] Writing DB stats cinder:UPDATE=1 {{(pid=75624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:34:35 devstack cinder-volume[75624]: DEBUG oslo_service.periodic_task [None req-026f072b-a817-419e-adf4-572c8de9343e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 06:34:35 devstack cinder-volume[75624]: DEBUG cinder.volume.drivers.lvm [None req-026f072b-a817-419e-adf4-572c8de9343e None None] Updating volume stats {{(pid=75624) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 06:34:35 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-026f072b-a817-419e-adf4-572c8de9343e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:34:35 devstack sudo[82046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 06:34:35 devstack sudo[82046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:34:36 devstack sudo[82046]: pam_unix(sudo:session): session closed for user root Apr 29 06:34:36 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-026f072b-a817-419e-adf4-572c8de9343e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.592s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:34:36 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-026f072b-a817-419e-adf4-572c8de9343e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:34:36 devstack sudo[82050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 06:34:36 devstack sudo[82050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:34:36 devstack sudo[82050]: pam_unix(sudo:session): session closed for user root Apr 29 06:34:36 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-026f072b-a817-419e-adf4-572c8de9343e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.596s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:34:36 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-026f072b-a817-419e-adf4-572c8de9343e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:34:36 devstack sudo[82054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 06:34:36 devstack sudo[82054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:34:37 devstack sudo[82054]: pam_unix(sudo:session): session closed for user root Apr 29 06:34:37 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-026f072b-a817-419e-adf4-572c8de9343e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.643s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:34:37 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-026f072b-a817-419e-adf4-572c8de9343e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:34:37 devstack sudo[82058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 06:34:37 devstack sudo[82058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:34:38 devstack sudo[82058]: pam_unix(sudo:session): session closed for user root Apr 29 06:34:38 devstack cinder-volume[75624]: DEBUG oslo_concurrency.processutils [None req-026f072b-a817-419e-adf4-572c8de9343e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=75624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:34:38 devstack cinder-volume[75624]: DEBUG cinder.manager [None req-026f072b-a817-419e-adf4-572c8de9343e None None] Notifying Schedulers of capabilities ... {{(pid=75624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:34:52 devstack cinder-volume[75455]: INFO oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Caught SIGTERM, stopping children Apr 29 06:34:52 devstack cinder-volume[75455]: DEBUG oslo_concurrency.lockutils [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Acquiring lock "singleton_lock" {{(pid=75455) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 06:34:52 devstack cinder-volume[75455]: DEBUG oslo_concurrency.lockutils [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Acquired lock "singleton_lock" {{(pid=75455) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 06:34:52 devstack cinder-volume[75455]: DEBUG oslo_concurrency.lockutils [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Releasing lock "singleton_lock" {{(pid=75455) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 06:34:52 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Stop services. {{(pid=75455) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 29 06:34:52 devstack cinder-volume[75455]: DEBUG oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Killing children. {{(pid=75455) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 29 06:34:52 devstack cinder-volume[75455]: INFO oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Waiting on 1 children to exit Apr 29 06:34:53 devstack cinder-volume[75624]: DEBUG oslo_concurrency.lockutils [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Acquiring lock "singleton_lock" {{(pid=75624) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 06:34:53 devstack cinder-volume[75624]: DEBUG oslo_concurrency.lockutils [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Acquired lock "singleton_lock" {{(pid=75624) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 06:34:53 devstack cinder-volume[75624]: DEBUG oslo_concurrency.lockutils [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Releasing lock "singleton_lock" {{(pid=75624) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 06:34:53 devstack cinder-volume[75624]: WARNING amqp [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 06:34:53 devstack cinder-volume[75624]: WARNING amqp [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 06:34:53 devstack cinder-volume[75455]: INFO oslo_service.backend._eventlet.service [None req-a0a47eb3-6c90-475e-9b9a-79330793040a None None] Child 75624 exited with status 0 Apr 29 06:34:55 devstack cinder-volume[83278]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83278) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 06:34:55 devstack cinder-volume[83278]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83278) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 06:34:55 devstack cinder-volume[83278]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83278) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 06:34:56 devstack cinder-volume[83278]: INFO dbcounter [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] Registered counter for database cinder Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_db.sqlalchemy.engines [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83278) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG dbcounter [-] [83278] Writer thread running {{(pid=83278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 06:34:56 devstack cinder-volume[83278]: INFO cinder.rpc [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 06:34:56 devstack cinder-volume[83278]: INFO cinder.rpc [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_db.sqlalchemy.engines [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83278) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 06:34:56 devstack cinder-volume[83278]: INFO cinder.volume.manager [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] Determined volume DB was empty at startup. Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG cinder.volume.manager [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83278) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 06:34:56 devstack cinder-volume[83278]: INFO cinder.volume.manager [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 29 06:34:56 devstack cinder-volume[83278]: WARNING stevedore.named [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 06:34:56 devstack cinder-volume[83278]: WARNING castellan.key_manager [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 06:34:56 devstack cinder-volume[83278]: WARNING cinder.keymgr.conf_key_mgr [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 06:34:56 devstack cinder-volume[83278]: INFO cinder.volume.manager [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_db.sqlalchemy.engines [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83278) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 06:34:56 devstack cinder-volume[83278]: INFO oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] Starting 1 workers Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] Started child 83485 {{(pid=83278) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] Full set of CONF: {{(pid=83278) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] ******************************************************************************** {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] Configuration options gathered from: {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] ================================================================================ {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] allow_availability_zone_fallback = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] allow_compression_on_image_upload = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] allowed_direct_url_schemes = [] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] api_rate_limit = True {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] auth_strategy = keystone {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_availability_zone = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_host = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_name = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_stats_polling_interval = 60 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backup_api_class = cinder.backup.api.API {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backup_name_template = backup-%s {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backup_use_same_host = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backup_use_temp_snapshot = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] chap_password = **** {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] chap_username = {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cinder_internal_tenant_project_id = c8d5e4874fce4f87b9bea9898af9a715 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cinder_internal_tenant_user_id = ca6629b861784330bc5d161a5774d9a1 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cluster = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] compression_format = gzip {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] compute_api_class = cinder.compute.nova.API {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] config_dir = [] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] config_source = [] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] control_exchange = openstack {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] debug = True {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] default_availability_zone = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] default_group_type = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:56 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] default_volume_type = QuobyteHD {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83485]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] disk_geometry = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] driver_client_cert = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] driver_client_cert_key = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] driver_data_namespace = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] driver_ssl_cert_path = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] driver_ssl_cert_verify = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] driver_use_ssl = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] enable_new_services = True {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] enable_unsupported_driver = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] enabled_backends = ['QuobyteHD'] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] enforce_multipath_for_image_xfer = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] filter_function = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] glance_api_insecure = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] glance_api_servers = ['http://192.168.122.96/image'] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] glance_api_ssl_compression = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] glance_ca_certificates_file = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] glance_catalog_info = image:glance:publicURL {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] glance_certfile = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] glance_keyfile = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] glance_num_retries = 3 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] glance_request_timeout = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] goodness_function = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] graceful_shutdown_timeout = 5 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] group_api_class = cinder.group.api.API {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] host = devstack {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] image_compress_on_upload = True {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] image_conversion_address_space_limit = 1 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] image_conversion_cpu_limit = 60 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] image_conversion_disable = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] image_upload_use_cinder_backend = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] image_upload_use_internal_tenant = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] image_volume_cache_enabled = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] image_volume_cache_max_count = 0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] image_volume_cache_max_size_gb = 0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] init_host_max_objects_retrieval = 0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] instance_format = [instance: %(uuid)s] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] iscsi_target_flags = {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] iscsi_write_cache = on {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83485]: INFO cinder.volume.manager [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 29 06:34:57 devstack cinder-volume[83485]: DEBUG cinder.volume.drivers.remotefs [None req-fb875df0-b01d-4629-8d14-796669194565 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83485) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] iser_helper = tgtadm {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] iser_ip_address = 192.168.122.96 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] iser_port = 3260 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] log_color = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] log_config_append = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] log_dir = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] log_file = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] log_options = True {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] log_rotate_interval = 1 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] log_rotate_interval_type = days {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] log_rotation_type = none {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] max_age = 0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] max_logfile_count = 30 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] max_logfile_size_mb = 200 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] max_over_subscription_ratio = 20.0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] message_reap_interval = 86400 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] message_ttl = 2592000 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] migration_create_volume_timeout_secs = 300 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] monkey_patch = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] monkey_patch_modules = [] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] my_ip = 192.168.122.96 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] no_snapshot_gb_quota = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] num_iser_scan_tries = 3 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] num_shell_tries = 3 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] num_volume_device_scan_tries = 3 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] nvmeof_conn_info_version = 1 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] nvmet_ns_id = 10 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] nvmet_port_id = 1 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] osapi_max_limit = 1000 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] osapi_volume_ext_list = [] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] osapi_volume_listen_port = 8776 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] osapi_volume_use_ssl = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] osapi_volume_workers = 2 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] per_volume_size_limit = -1 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] periodic_fuzzy_delay = 60 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] periodic_interval = 60 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] public_endpoint = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] publish_errors = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] quota_backup_gigabytes = 1000 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] quota_backups = 10 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] quota_gigabytes = 1000 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] quota_groups = 10 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] quota_snapshots = 10 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] quota_volumes = 10 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] rate_limit_burst = 0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] rate_limit_except_level = CRITICAL {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] rate_limit_interval = 0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] reinit_driver_count = 3 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] replication_device = **** {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] report_discard_supported = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] report_interval = 120 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] reservation_clean_interval = 86400 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] reservation_expire = 86400 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] reserved_image_namespaces = [] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] reserved_percentage = 0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] rpc_response_timeout = 120 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] run_external_periodic_tasks = True {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] scst_target_driver = iscsi {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] scst_target_iqn_name = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] service_down_time = 720 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] shell_completion = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] snapshot_name_template = snapshot-%s {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] split_loggers = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] state_path = /opt/stack/data/cinder {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] storage_availability_zone = nova {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] storage_protocol = iSCSI {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] syslog_log_facility = LOG_USER {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] target_helper = lioadm {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] target_ip_address = 192.168.122.96 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] target_port = 3260 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] target_protocol = iscsi {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] target_secondary_ip_addresses = [] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] trace_flags = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] transport_url = **** {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] until_refresh = 0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] use_chap_auth = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] use_default_quota_class = True {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] use_journal = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] use_json = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] use_multipath_for_image_xfer = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] use_stderr = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] use_syslog = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] verify_glance_signatures = enabled {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] volume_api_class = cinder.volume.api.API {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] volume_backend_name = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] volume_clear = zero {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] volume_clear_ionice = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] volume_clear_size = 0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] volume_copy_bps_limit = 0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] volume_dd_blocksize = 1M {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] volume_name_template = volume-%s {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] volume_service_inithost_offload = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] volume_usage_audit_period = month {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] zoning_mode = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_concurrency.disable_process_locking = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.admin_password = **** {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.admin_token = **** {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.admin_user = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.auth_admin_prefix = {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.auth_port = 35357 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.auth_protocol = https {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.auth_section = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.auth_type = password {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.auth_uri = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83485]: DEBUG cinder.volume.drivers.quobyte [None req-fb875df0-b01d-4629-8d14-796669194565 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83485) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 29 06:34:57 devstack cinder-volume[83485]: WARNING cinder.volume.drivers.quobyte [None req-fb875df0-b01d-4629-8d14-796669194565 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 29 06:34:57 devstack cinder-volume[83485]: WARNING cinder.volume.drivers.quobyte [None req-fb875df0-b01d-4629-8d14-796669194565 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 29 06:34:57 devstack cinder-volume[83485]: DEBUG oslo_concurrency.processutils [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Running cmd (subprocess): mount.quobyte {{(pid=83485) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.auth_version = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.cache = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.certfile = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.identity_uri = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.include_service_catalog = True {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.insecure = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.interface = public {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.keyfile = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.memcache_password = {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.memcache_username = {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.region_name = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.service_type = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.96/identity {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.backend = dogpile.cache.null {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.backend_argument = **** {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.backend_expiration_time = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.config_prefix = cache.oslo {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.debug_cache_backend = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.enable_retry_client = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.enable_socket_keepalive = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.enabled = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.enforce_fips_mode = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.expiration_time = 600 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.hashclient_retry_attempts = 2 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.memcache_dead_retry = 300 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.memcache_pool_maxsize = 10 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.memcache_sasl_enabled = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.password = **** {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.proxies = [] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.redis_db = 0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.redis_server = localhost:6379 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.retry_attempts = 2 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.retry_delay = 0.0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.socket_keepalive_count = 1 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.socket_keepalive_idle = 1 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.socket_keepalive_interval = 1 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.socket_timeout = 1.0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.tls_allowed_ciphers = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.tls_cafile = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.tls_certfile = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.tls_enabled = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.tls_keyfile = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cache.username = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] coordination.backend_url = **** {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] database.asyncio_connection = **** {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] database.asyncio_slave_connection = **** {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] database.backend = sqlalchemy {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] database.connection = **** {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] database.connection_debug = 0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] database.connection_parameters = {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] database.connection_recycle_time = 3600 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] database.connection_trace = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] database.db_inc_retry_interval = True {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] database.db_max_retries = 20 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] database.db_max_retry_interval = 10 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] database.db_retry_interval = 1 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] database.max_overflow = 50 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] database.max_pool_size = 5 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] database.max_retries = 10 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] database.mysql_wsrep_sync_wait = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] database.pool_timeout = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] database.retry_interval = 10 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] database.slave_connection = **** {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] database.sqlite_synchronous = True {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] database.synchronous_reader = True {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] database.use_db_reconnect = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] profiler.connection_string = messaging:// {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] profiler.enabled = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] profiler.es_doc_type = notification {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] profiler.es_scroll_size = 10000 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] profiler.es_scroll_time = 2m {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] profiler.filter_error_trace = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] profiler.hmac_keys = **** {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] profiler.sentinel_service_name = mymaster {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] profiler.socket_timeout = 0.1 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] profiler.trace_requests = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] profiler.trace_sqlalchemy = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] profiler_jaeger.process_tags = {} {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] profiler_jaeger.service_name_prefix = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] profiler_otlp.service_name_prefix = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_policy.enforce_new_defaults = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: WARNING oslo_config.cfg [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_policy.enforce_scope = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_policy.policy_default_rule = default {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_policy.policy_file = policy.yaml {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] privsep_osbrick.group = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] privsep_osbrick.helper_command = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] privsep_osbrick.user = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cinder_sys_admin.group = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cinder_sys_admin.helper_command = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] cinder_sys_admin.user = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] service_user.auth_section = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] service_user.auth_type = password {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] service_user.cafile = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] service_user.certfile = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] service_user.collect_timing = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] service_user.insecure = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] service_user.keyfile = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] service_user.send_service_user_token = True {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] service_user.split_loggers = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] service_user.timeout = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] glance.auth_section = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] glance.auth_type = password {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83485]: DEBUG oslo_concurrency.processutils [None req-fb875df0-b01d-4629-8d14-796669194565 None None] CMD "mount.quobyte" returned: 1 in 0.213s {{(pid=83485) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] glance.certfile = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] glance.collect_timing = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] glance.insecure = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] glance.keyfile = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] glance.region_name = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83485]: DEBUG oslo_concurrency.lockutils [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83485) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:34:57 devstack cinder-volume[83485]: DEBUG oslo_concurrency.lockutils [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83485) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:34:57 devstack cinder-volume[83485]: DEBUG cinder.volume.drivers.quobyte [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=83485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] glance.split_loggers = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] glance.timeout = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.backend_availability_zone = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.chap_password = **** {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.chap_username = {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.disk_geometry = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83485]: INFO cinder.volume.drivers.quobyte [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 ... Apr 29 06:34:57 devstack cinder-volume[83485]: DEBUG oslo_concurrency.processutils [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae -c /etc/quobyte/client-cinder.cfg {{(pid=83485) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.driver_client_cert = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.driver_client_cert_key = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.driver_data_namespace = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.driver_use_ssl = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.extra_capabilities = {} {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.filter_function = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.goodness_function = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.iscsi_target_flags = {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.iscsi_write_cache = on {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.iser_helper = tgtadm {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.iser_ip_address = 192.168.122.96 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.iser_port = 3260 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.nas_host = {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.nas_login = admin {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.nas_mount_options = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.nas_password = **** {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.nas_private_key = {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.nas_share_path = {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.nas_ssh_port = 22 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.num_shell_tries = 3 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.quobyte_volume_url = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.replication_device = **** {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.report_discard_supported = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.reserved_percentage = 0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.target_helper = tgtadm {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.target_ip_address = 192.168.122.96 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.target_port = 3260 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.target_protocol = iscsi {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.trace_flags = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.unique_fqdn_network = True {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.use_chap_auth = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.volume_backend_name = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.volume_clear = zero {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.volume_clear_ionice = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.volume_clear_size = 0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_reports.file_event_handler = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_reports.log_dir = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.backend_availability_zone = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.backend_host = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.chap_password = **** {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.chap_username = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.chiscsi_conf = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.disk_geometry = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.driver_client_cert = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.driver_data_namespace = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.driver_use_ssl = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.extra_capabilities = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.filter_function = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.goodness_function = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.iscsi_target_flags = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.iscsi_write_cache = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.iser_helper = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.iser_ip_address = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.iser_port = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.iser_target_prefix = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.nas_host = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.nas_login = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.nas_mount_options = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack sudo[83564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae -c /etc/quobyte/client-cinder.cfg Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.nas_password = **** {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.nas_private_key = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.nas_share_path = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.nas_ssh_port = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack sudo[83564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.num_shell_tries = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.nvmet_ns_id = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.nvmet_port_id = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.replication_device = **** {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.report_discard_supported = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.reserved_percentage = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.scst_target_driver = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.storage_protocol = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.target_helper = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.target_ip_address = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.target_port = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.target_prefix = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.target_protocol = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.trace_flags = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.unique_fqdn_network = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.use_chap_auth = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.volume_clear = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.volume_clear_ionice = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.volume_clear_size = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] QuobyteHD.volumes_dir = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.ssl = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_notifications.driver = [] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_notifications.retry = -1 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] key_manager.fixed_key = **** {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] barbican.barbican_api_version = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] barbican.barbican_endpoint = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] barbican.barbican_endpoint_type = public {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] barbican.barbican_region_name = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] barbican.cafile = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] barbican.certfile = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] barbican.collect_timing = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] barbican.insecure = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] barbican.keyfile = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] barbican.number_of_retries = 60 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] barbican.retry_delay = 1 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] barbican.send_service_user_token = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] barbican.split_loggers = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] barbican.timeout = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] barbican.verify_ssl = True {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] barbican.verify_ssl_path = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] barbican_service_user.auth_section = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] barbican_service_user.auth_type = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] barbican_service_user.cafile = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] barbican_service_user.certfile = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] barbican_service_user.collect_timing = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] barbican_service_user.insecure = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] barbican_service_user.keyfile = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] barbican_service_user.split_loggers = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] barbican_service_user.timeout = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] vault.approle_role_id = **** {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] vault.approle_secret_id = **** {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] vault.kv_mountpoint = secret {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] vault.kv_path = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] vault.kv_version = 2 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] vault.namespace = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] vault.root_token_id = **** {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] vault.ssl_ca_crt_file = None {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] vault.timeout = 60.0 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] vault.use_ssl = False {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:34:57 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] ******************************************************************************** {{(pid=83278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 06:34:58 devstack sudo[83564]: pam_unix(sudo:session): session closed for user root Apr 29 06:34:58 devstack cinder-volume[83485]: DEBUG oslo_concurrency.processutils [None req-fb875df0-b01d-4629-8d14-796669194565 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.866s {{(pid=83485) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:34:58 devstack cinder-volume[83485]: INFO cinder.volume.drivers.quobyte [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 succeeded Apr 29 06:34:58 devstack cinder-volume[83485]: DEBUG cinder.volume.drivers.quobyte [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=83485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:34:58 devstack cinder-volume[83485]: DEBUG oslo_concurrency.lockutils [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.886s {{(pid=83485) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:34:58 devstack cinder-volume[83485]: DEBUG oslo_concurrency.processutils [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=83485) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:34:58 devstack sudo[83653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:34:58 devstack sudo[83653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:34:58 devstack sudo[83653]: pam_unix(sudo:session): session closed for user root Apr 29 06:34:58 devstack cinder-volume[83485]: DEBUG oslo_concurrency.processutils [None req-fb875df0-b01d-4629-8d14-796669194565 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.610s {{(pid=83485) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:34:58 devstack cinder-volume[83485]: INFO cinder.volume.driver [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Driver hasn't implemented _init_vendor_properties() Apr 29 06:34:58 devstack cinder-volume[83485]: DEBUG cinder.volume.driver [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6482620239258, 'free_capacity_gb': 1775.6482620239258, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83485) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 06:34:59 devstack cinder-volume[83485]: DEBUG oslo_db.sqlalchemy.engines [None req-fb875df0-b01d-4629-8d14-796669194565 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83485) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 06:34:59 devstack cinder-volume[83485]: DEBUG dbcounter [-] [83485] Writer thread running {{(pid=83485) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 06:34:59 devstack cinder-volume[83485]: DEBUG cinder.db.sqlalchemy.api [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Building query based on filter {{(pid=83485) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 06:34:59 devstack cinder-volume[83485]: DEBUG cinder.image.image_utils [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83485) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 06:34:59 devstack cinder-volume[83485]: INFO cinder.keymgr.migration [None req-46e0622b-f20b-42fc-8f49-dc32ea4acee2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 06:34:59 devstack cinder-volume[83485]: DEBUG oslo_concurrency.lockutils [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83485) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:34:59 devstack cinder-volume[83485]: DEBUG oslo_concurrency.lockutils [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83485) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:34:59 devstack cinder-volume[83485]: DEBUG cinder.volume.drivers.quobyte [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=83485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:34:59 devstack cinder-volume[83485]: DEBUG cinder.volume.drivers.quobyte [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=83485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:34:59 devstack cinder-volume[83485]: DEBUG oslo_concurrency.lockutils [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83485) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:34:59 devstack cinder-volume[83485]: DEBUG oslo_concurrency.processutils [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=83485) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:34:59 devstack sudo[83676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:34:59 devstack sudo[83676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:34:59 devstack sudo[83676]: pam_unix(sudo:session): session closed for user root Apr 29 06:34:59 devstack cinder-volume[83485]: DEBUG oslo_concurrency.processutils [None req-fb875df0-b01d-4629-8d14-796669194565 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.585s {{(pid=83485) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:34:59 devstack cinder-volume[83485]: DEBUG cinder.manager [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Notifying Schedulers of capabilities ... {{(pid=83485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:34:59 devstack cinder-volume[83485]: INFO cinder.volume.manager [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Driver initialization completed successfully. Apr 29 06:34:59 devstack cinder-volume[83485]: INFO cinder.manager [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Initiating service 3 cleanup Apr 29 06:34:59 devstack cinder-volume[83485]: INFO cinder.manager [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Service 3 cleanup completed. Apr 29 06:34:59 devstack cinder-volume[83485]: DEBUG cinder.service [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Creating RPC server for service cinder-volume {{(pid=83485) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 06:34:59 devstack cinder-volume[83485]: DEBUG cinder.service [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83485) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 06:34:59 devstack cinder-volume[83485]: INFO cinder.volume.manager [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 29 06:34:59 devstack cinder-volume[83485]: DEBUG oslo_concurrency.lockutils [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83485) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:34:59 devstack cinder-volume[83485]: DEBUG oslo_concurrency.lockutils [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83485) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:34:59 devstack cinder-volume[83485]: DEBUG cinder.volume.drivers.quobyte [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=83485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:34:59 devstack cinder-volume[83485]: DEBUG cinder.volume.drivers.quobyte [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=83485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:34:59 devstack cinder-volume[83485]: DEBUG oslo_concurrency.lockutils [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83485) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:34:59 devstack cinder-volume[83485]: DEBUG oslo_concurrency.processutils [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=83485) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:34:59 devstack sudo[83693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:34:59 devstack sudo[83693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:35:00 devstack sudo[83693]: pam_unix(sudo:session): session closed for user root Apr 29 06:35:00 devstack cinder-volume[83485]: DEBUG oslo_concurrency.processutils [None req-fb875df0-b01d-4629-8d14-796669194565 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.771s {{(pid=83485) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:35:00 devstack cinder-volume[83485]: INFO cinder.volume.manager [None req-fb875df0-b01d-4629-8d14-796669194565 None None] Driver post RPC initialization completed successfully. Apr 29 06:35:04 devstack cinder-volume[83485]: DEBUG oslo_concurrency.lockutils [None req-639b40f1-8a65-4dd3-8a18-5386520760da None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83485) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:35:04 devstack cinder-volume[83485]: DEBUG oslo_concurrency.lockutils [None req-639b40f1-8a65-4dd3-8a18-5386520760da None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83485) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:35:04 devstack cinder-volume[83485]: DEBUG cinder.volume.drivers.quobyte [None req-639b40f1-8a65-4dd3-8a18-5386520760da None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=83485) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:35:04 devstack cinder-volume[83485]: DEBUG cinder.volume.drivers.quobyte [None req-639b40f1-8a65-4dd3-8a18-5386520760da None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=83485) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:35:04 devstack cinder-volume[83485]: DEBUG oslo_concurrency.lockutils [None req-639b40f1-8a65-4dd3-8a18-5386520760da None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83485) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:35:04 devstack cinder-volume[83485]: DEBUG oslo_concurrency.processutils [None req-639b40f1-8a65-4dd3-8a18-5386520760da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=83485) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:35:04 devstack sudo[83844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:35:04 devstack sudo[83844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:35:05 devstack sudo[83844]: pam_unix(sudo:session): session closed for user root Apr 29 06:35:05 devstack cinder-volume[83485]: DEBUG oslo_concurrency.processutils [None req-639b40f1-8a65-4dd3-8a18-5386520760da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.555s {{(pid=83485) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:35:05 devstack cinder-volume[83485]: DEBUG cinder.manager [None req-639b40f1-8a65-4dd3-8a18-5386520760da None None] Notifying Schedulers of capabilities ... {{(pid=83485) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:35:06 devstack cinder-volume[83278]: DEBUG dbcounter [-] [83278] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:35:07 devstack cinder-volume[83278]: INFO oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] Caught SIGTERM, stopping children Apr 29 06:35:07 devstack cinder-volume[83278]: DEBUG oslo_concurrency.lockutils [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] Acquiring lock "singleton_lock" {{(pid=83278) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 06:35:07 devstack cinder-volume[83278]: DEBUG oslo_concurrency.lockutils [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] Acquired lock "singleton_lock" {{(pid=83278) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 06:35:07 devstack cinder-volume[83278]: DEBUG oslo_concurrency.lockutils [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] Releasing lock "singleton_lock" {{(pid=83278) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 06:35:07 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] Stop services. {{(pid=83278) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 29 06:35:07 devstack cinder-volume[83278]: DEBUG oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] Killing children. {{(pid=83278) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 29 06:35:07 devstack cinder-volume[83278]: INFO oslo_service.backend._eventlet.service [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] Waiting on 1 children to exit Apr 29 06:35:10 devstack cinder-volume[83485]: DEBUG dbcounter [-] [83485] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83485) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:35:10 devstack cinder-volume[83485]: DEBUG dbcounter [-] [83485] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=83485) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:35:12 devstack cinder-volume[83485]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Apr 29 06:35:13 devstack cinder-volume[83485]: DEBUG oslo_concurrency.lockutils [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] Acquiring lock "singleton_lock" {{(pid=83485) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 06:35:13 devstack cinder-volume[83485]: DEBUG oslo_concurrency.lockutils [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] Acquired lock "singleton_lock" {{(pid=83485) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 06:35:13 devstack cinder-volume[83485]: DEBUG oslo_concurrency.lockutils [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] Releasing lock "singleton_lock" {{(pid=83485) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 06:35:13 devstack cinder-volume[83485]: WARNING amqp [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 06:35:13 devstack cinder-volume[83485]: WARNING amqp [None req-63f0662c-c68b-4d8d-93d4-0c3a9b658ea9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 06:35:15 devstack cinder-volume[83925]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83925) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 06:35:15 devstack cinder-volume[83925]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83925) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 06:35:15 devstack cinder-volume[83925]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83925) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 06:35:15 devstack cinder-volume[83925]: INFO dbcounter [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] Registered counter for database cinder Apr 29 06:35:15 devstack cinder-volume[83925]: DEBUG oslo_db.sqlalchemy.engines [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83925) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 06:35:15 devstack cinder-volume[83925]: DEBUG dbcounter [-] [83925] Writer thread running {{(pid=83925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 06:35:15 devstack cinder-volume[83925]: INFO cinder.rpc [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 06:35:15 devstack cinder-volume[83925]: INFO cinder.rpc [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 06:35:15 devstack cinder-volume[83925]: DEBUG oslo_db.sqlalchemy.engines [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83925) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 06:35:16 devstack cinder-volume[83925]: INFO cinder.volume.manager [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] Determined volume DB was empty at startup. Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG cinder.volume.manager [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83925) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 06:35:16 devstack cinder-volume[83925]: WARNING stevedore.named [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 06:35:16 devstack cinder-volume[83925]: WARNING castellan.key_manager [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 06:35:16 devstack cinder-volume[83925]: WARNING cinder.keymgr.conf_key_mgr [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 06:35:16 devstack cinder-volume[83925]: INFO cinder.volume.manager [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_db.sqlalchemy.engines [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83925) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 06:35:16 devstack cinder-volume[83925]: INFO oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] Starting 1 workers Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] Started child 84195 {{(pid=83925) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] Full set of CONF: {{(pid=83925) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] ******************************************************************************** {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] Configuration options gathered from: {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] ================================================================================ {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] allow_availability_zone_fallback = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] allow_compression_on_image_upload = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] allowed_direct_url_schemes = [] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] api_rate_limit = True {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] auth_strategy = keystone {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_availability_zone = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_host = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_name = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_stats_polling_interval = 60 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backup_api_class = cinder.backup.api.API {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backup_name_template = backup-%s {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backup_use_same_host = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[84195]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backup_use_temp_snapshot = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] chap_password = **** {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] chap_username = {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cinder_internal_tenant_project_id = c8d5e4874fce4f87b9bea9898af9a715 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cinder_internal_tenant_user_id = ca6629b861784330bc5d161a5774d9a1 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cluster = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] compression_format = gzip {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] compute_api_class = cinder.compute.nova.API {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] config_dir = [] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] config_source = [] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] control_exchange = openstack {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] debug = True {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] default_availability_zone = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] default_group_type = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] default_volume_type = QuobyteHD {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] disk_geometry = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] driver_client_cert = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] driver_client_cert_key = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] driver_data_namespace = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] driver_ssl_cert_path = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] driver_ssl_cert_verify = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] driver_use_ssl = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] enable_new_services = True {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] enable_unsupported_driver = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] enabled_backends = ['QuobyteHD'] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] enforce_multipath_for_image_xfer = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] filter_function = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] glance_api_insecure = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] glance_api_servers = ['http://192.168.122.96/image'] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] glance_api_ssl_compression = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] glance_ca_certificates_file = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] glance_catalog_info = image:glance:publicURL {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] glance_certfile = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] glance_keyfile = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] glance_num_retries = 3 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] glance_request_timeout = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] goodness_function = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] graceful_shutdown_timeout = 5 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] group_api_class = cinder.group.api.API {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] host = devstack {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] image_compress_on_upload = True {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] image_conversion_address_space_limit = 1 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] image_conversion_cpu_limit = 60 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] image_conversion_disable = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] image_upload_use_cinder_backend = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] image_upload_use_internal_tenant = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] image_volume_cache_enabled = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] image_volume_cache_max_count = 0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] image_volume_cache_max_size_gb = 0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] init_host_max_objects_retrieval = 0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] instance_format = [instance: %(uuid)s] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] iscsi_target_flags = {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] iscsi_write_cache = on {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] iser_helper = tgtadm {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] iser_ip_address = 192.168.122.96 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] iser_port = 3260 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] log_color = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] log_config_append = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] log_dir = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] log_file = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] log_options = True {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] log_rotate_interval = 1 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] log_rotate_interval_type = days {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] log_rotation_type = none {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] max_age = 0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] max_logfile_count = 30 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] max_logfile_size_mb = 200 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] max_over_subscription_ratio = 20.0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] message_reap_interval = 86400 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] message_ttl = 2592000 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] migration_create_volume_timeout_secs = 300 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] monkey_patch = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] monkey_patch_modules = [] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] my_ip = 192.168.122.96 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] no_snapshot_gb_quota = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] num_iser_scan_tries = 3 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] num_shell_tries = 3 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] num_volume_device_scan_tries = 3 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] nvmeof_conn_info_version = 1 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] nvmet_ns_id = 10 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] nvmet_port_id = 1 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] osapi_max_limit = 1000 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] osapi_volume_ext_list = [] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] osapi_volume_listen = 0.0.0.0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] osapi_volume_listen_port = 8776 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] osapi_volume_use_ssl = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] osapi_volume_workers = 2 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] per_volume_size_limit = -1 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] periodic_fuzzy_delay = 60 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] periodic_interval = 60 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] project_id_regex = [0-9a-f\-]+ {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] public_endpoint = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] publish_errors = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] quota_backup_gigabytes = 1000 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] quota_backups = 10 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] quota_gigabytes = 1000 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] quota_groups = 10 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] quota_snapshots = 10 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] quota_volumes = 10 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] rate_limit_burst = 0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] rate_limit_except_level = CRITICAL {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] rate_limit_interval = 0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] reinit_driver_count = 3 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] replication_device = **** {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] report_discard_supported = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] report_interval = 120 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] reservation_clean_interval = 86400 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] reservation_expire = 86400 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] reserved_image_namespaces = [] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] reserved_percentage = 0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=84195) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] rpc_response_timeout = 120 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] run_external_periodic_tasks = True {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] scst_target_driver = iscsi {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] scst_target_iqn_name = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] service_down_time = 720 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] shell_completion = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] snapshot_name_template = snapshot-%s {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] split_loggers = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] state_path = /opt/stack/data/cinder {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] storage_availability_zone = nova {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] storage_protocol = iSCSI {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] syslog_log_facility = LOG_USER {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] target_helper = lioadm {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] target_ip_address = 192.168.122.96 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] target_port = 3260 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] target_protocol = iscsi {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] target_secondary_ip_addresses = [] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] trace_flags = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] transfer_api_class = cinder.transfer.api.API {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] transport_url = **** {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] until_refresh = 0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] use_chap_auth = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] use_default_quota_class = True {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] use_journal = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] use_json = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] use_multipath_for_image_xfer = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] use_stderr = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] use_syslog = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] verify_glance_signatures = enabled {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] volume_api_class = cinder.volume.api.API {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] volume_backend_name = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] volume_clear = zero {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] volume_clear_ionice = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] volume_clear_size = 0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] volume_copy_bps_limit = 0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] volume_dd_blocksize = 1M {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] volume_name_template = volume-%s {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] volume_service_inithost_offload = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] volume_usage_audit_period = month {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] zoning_mode = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_concurrency.disable_process_locking = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.admin_password = **** {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.admin_token = **** {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.admin_user = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.auth_admin_prefix = {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.auth_port = 35357 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.auth_protocol = https {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.auth_section = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.auth_type = password {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.auth_uri = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.auth_version = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.cache = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.certfile = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.delay_auth_decision = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.http_connect_timeout = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.identity_uri = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.include_service_catalog = True {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.insecure = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.interface = public {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.keyfile = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.memcache_password = {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.memcache_username = {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.region_name = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.service_token_roles_required = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.service_type = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.token_cache_time = 300 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.96/identity {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.backend = dogpile.cache.null {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.backend_argument = **** {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.backend_expiration_time = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.config_prefix = cache.oslo {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.debug_cache_backend = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.enable_retry_client = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.enable_socket_keepalive = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.enabled = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.enforce_fips_mode = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.expiration_time = 600 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.hashclient_retry_attempts = 2 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.memcache_dead_retry = 300 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.memcache_pool_maxsize = 10 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.memcache_sasl_enabled = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.password = **** {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.proxies = [] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.redis_db = 0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.redis_sentinel_service_name = mymaster {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.redis_server = localhost:6379 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.retry_attempts = 2 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.retry_delay = 0.0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.socket_keepalive_count = 1 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.socket_keepalive_idle = 1 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.socket_keepalive_interval = 1 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.socket_timeout = 1.0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.tls_allowed_ciphers = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.tls_cafile = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.tls_certfile = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.tls_enabled = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.tls_keyfile = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cache.username = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] coordination.backend_url = **** {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] database.asyncio_connection = **** {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] database.asyncio_slave_connection = **** {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] database.backend = sqlalchemy {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] database.connection = **** {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] database.connection_debug = 0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] database.connection_parameters = {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] database.connection_recycle_time = 3600 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] database.connection_trace = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] database.db_inc_retry_interval = True {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] database.db_max_retries = 20 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] database.db_max_retry_interval = 10 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] database.db_retry_interval = 1 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] database.max_overflow = 50 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] database.max_pool_size = 5 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] database.max_retries = 10 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] database.mysql_wsrep_sync_wait = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] database.pool_timeout = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] database.retry_interval = 10 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] database.slave_connection = **** {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] database.sqlite_synchronous = True {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] database.synchronous_reader = True {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] database.use_db_reconnect = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] profiler.connection_string = messaging:// {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] profiler.enabled = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] profiler.es_doc_type = notification {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] profiler.es_scroll_size = 10000 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] profiler.es_scroll_time = 2m {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] profiler.filter_error_trace = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] profiler.hmac_keys = **** {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] profiler.sentinel_service_name = mymaster {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] profiler.socket_timeout = 0.1 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] profiler.trace_requests = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] profiler.trace_sqlalchemy = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] profiler_jaeger.process_tags = {} {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] profiler_jaeger.service_name_prefix = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] profiler_otlp.service_name_prefix = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_policy.enforce_new_defaults = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: WARNING oslo_config.cfg [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_policy.enforce_scope = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_policy.policy_default_rule = default {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_policy.policy_file = policy.yaml {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_policy.remote_timeout = 60.0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] privsep_osbrick.group = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] privsep_osbrick.helper_command = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] privsep_osbrick.user = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cinder_sys_admin.group = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cinder_sys_admin.helper_command = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=84195) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] cinder_sys_admin.user = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.quobyte [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] service_user.auth_section = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.quobyte [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] service_user.auth_type = password {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] service_user.cafile = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] service_user.certfile = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] service_user.collect_timing = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] service_user.insecure = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] service_user.keyfile = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] service_user.send_service_user_token = True {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] service_user.split_loggers = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] service_user.timeout = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] glance.auth_section = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] glance.auth_type = password {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Running cmd (subprocess): mount.quobyte {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] glance.certfile = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] glance.collect_timing = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] glance.insecure = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] glance.keyfile = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] glance.region_name = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] glance.split_loggers = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] glance.timeout = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.backend_availability_zone = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.chap_password = **** {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.chap_username = {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.disk_geometry = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.driver_client_cert = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.driver_client_cert_key = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.driver_data_namespace = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.driver_use_ssl = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.enable_unsupported_driver = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.extra_capabilities = {} {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.filter_function = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.goodness_function = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.iscsi_target_flags = {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.iscsi_write_cache = on {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.iser_helper = tgtadm {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.iser_ip_address = 192.168.122.96 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.iser_port = 3260 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.nas_host = {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.nas_login = admin {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.nas_mount_options = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.nas_password = **** {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.nas_private_key = {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.nas_share_path = {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.nas_ssh_port = 22 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.num_shell_tries = 3 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.nvmet_port_id = 1 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.quobyte_client_cfg = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.quobyte_volume_url = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.replication_device = **** {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.report_discard_supported = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.reserved_percentage = 0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.scst_target_driver = iscsi {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.scst_target_iqn_name = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.storage_protocol = iSCSI {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.target_helper = tgtadm {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.target_ip_address = 192.168.122.96 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.target_port = 3260 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.target_protocol = iscsi {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.trace_flags = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.unique_fqdn_network = True {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.use_chap_auth = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.volume_backend_name = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.volume_clear = zero {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.volume_clear_ionice = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.volume_clear_size = 0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_reports.file_event_handler = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_reports.log_dir = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.backend_availability_zone = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.backend_host = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.chap_password = **** {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.chap_username = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.chiscsi_conf = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.disk_geometry = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.driver_client_cert = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.driver_client_cert_key = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.driver_data_namespace = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.driver_use_ssl = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.extra_capabilities = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.filter_function = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.goodness_function = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.iscsi_target_flags = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.iscsi_write_cache = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.iser_helper = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.iser_ip_address = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.iser_port = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.iser_target_prefix = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.nas_host = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.nas_login = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.nas_mount_options = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.nas_password = **** {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.nas_private_key = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.nas_share_path = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.nas_ssh_port = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.num_shell_tries = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.nvmet_ns_id = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.nvmet_port_id = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.replication_device = **** {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.report_discard_supported = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.reserved_percentage = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.scst_target_driver = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.storage_protocol = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.target_helper = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.target_ip_address = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.target_port = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.target_prefix = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.target_protocol = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.trace_flags = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.unique_fqdn_network = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.use_chap_auth = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.volume_clear = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.volume_clear_ionice = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.volume_clear_size = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] QuobyteHD.volumes_dir = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.ssl = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.ssl_version = {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_notifications.driver = [] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_notifications.retry = -1 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] oslo_messaging_notifications.transport_url = **** {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] key_manager.fixed_key = **** {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] barbican.barbican_api_version = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] barbican.barbican_endpoint = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] barbican.barbican_endpoint_type = public {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] barbican.barbican_region_name = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] barbican.cafile = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] barbican.certfile = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] barbican.collect_timing = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] barbican.insecure = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] barbican.keyfile = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] barbican.number_of_retries = 60 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] barbican.retry_delay = 1 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] barbican.send_service_user_token = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] barbican.split_loggers = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] barbican.timeout = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] barbican.verify_ssl = True {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] barbican.verify_ssl_path = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] barbican_service_user.auth_section = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] barbican_service_user.auth_type = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] barbican_service_user.cafile = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] barbican_service_user.certfile = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] barbican_service_user.collect_timing = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] barbican_service_user.insecure = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] barbican_service_user.keyfile = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] barbican_service_user.split_loggers = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] barbican_service_user.timeout = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] vault.approle_role_id = **** {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] vault.approle_secret_id = **** {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] vault.kv_mountpoint = secret {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] vault.kv_path = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] vault.kv_version = 2 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] vault.namespace = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] vault.root_token_id = **** {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] vault.ssl_ca_crt_file = None {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] vault.timeout = 60.0 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] vault.use_ssl = False {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 06:35:16 devstack cinder-volume[83925]: DEBUG oslo_service.backend._eventlet.service [None req-1262bd5a-ffa4-48e9-9f4f-65b31543fdba None None] ******************************************************************************** {{(pid=83925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 06:35:16 devstack quobyte-client[84202]: Reading configuration file: /etc/quobyte/client.cfg Apr 29 06:35:16 devstack quobyte-client[84202]: Invalid parameters found, error: missing mount point. Apr 29 06:35:16 devstack quobyte-client[84202]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 29 06:35:16 devstack quobyte-client[84202]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 29 06:35:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] CMD "mount.quobyte" returned: 1 in 0.114s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:35:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:35:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:35:16 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:35:16 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:35:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:35:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:35:16 devstack sudo[84203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:35:16 devstack sudo[84203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:35:17 devstack sudo[84203]: pam_unix(sudo:session): session closed for user root Apr 29 06:35:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.605s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:35:17 devstack cinder-volume[84195]: INFO cinder.volume.driver [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Driver hasn't implemented _init_vendor_properties() Apr 29 06:35:17 devstack cinder-volume[84195]: DEBUG cinder.volume.driver [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.650302886963, 'free_capacity_gb': 1775.650302886963, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84195) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 06:35:17 devstack cinder-volume[84195]: DEBUG oslo_db.sqlalchemy.engines [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84195) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 06:35:17 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writer thread running {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 06:35:17 devstack cinder-volume[84195]: DEBUG cinder.db.sqlalchemy.api [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Building query based on filter {{(pid=84195) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 06:35:17 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=84195) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 06:35:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:35:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:35:17 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:35:17 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:35:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:35:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:35:17 devstack cinder-volume[84195]: INFO cinder.keymgr.migration [None req-ae20d8a5-1103-44c4-9473-086f9cb34a8c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 06:35:17 devstack sudo[84212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:35:17 devstack sudo[84212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:35:17 devstack sudo[84212]: pam_unix(sudo:session): session closed for user root Apr 29 06:35:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.593s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:35:17 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:35:17 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Driver initialization completed successfully. Apr 29 06:35:17 devstack cinder-volume[84195]: INFO cinder.manager [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Initiating service 3 cleanup Apr 29 06:35:17 devstack cinder-volume[84195]: INFO cinder.manager [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Service 3 cleanup completed. Apr 29 06:35:17 devstack cinder-volume[84195]: DEBUG cinder.service [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Creating RPC server for service cinder-volume {{(pid=84195) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 06:35:17 devstack cinder-volume[84195]: DEBUG cinder.service [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=84195) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 06:35:17 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 29 06:35:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:35:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:35:17 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:35:17 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:35:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:35:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:35:17 devstack sudo[84218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:35:17 devstack sudo[84218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:35:18 devstack sudo[84218]: pam_unix(sudo:session): session closed for user root Apr 29 06:35:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.626s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:35:18 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-896b967c-ee8d-4336-bbe2-7e8923c4e2f3 None None] Driver post RPC initialization completed successfully. Apr 29 06:35:26 devstack cinder-volume[83925]: DEBUG dbcounter [-] [83925] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:35:27 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:SELECT=3 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:35:28 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:36:16 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:36:16 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Flow 'volume_create_manager' (a7459ab0-780b-45a7-a9ca-ede67e640224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:36:16 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae77b31-3158-4271-b0b7-87f7f5f72983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:36:16 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-f75bed36-a3b3-46fb-aac4-e41e32b46940 tempest-GroupsV314Test-79219895 None] Group tempest-GroupsV314Test-Group-173621264: creating Apr 29 06:36:16 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae77b31-3158-4271-b0b7-87f7f5f72983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1561429040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27944bba-8d67-40ac-9561-3ed9608ff92e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dfe40112c894f5b9e937dd7e67337e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:36:16Z,use_quota=True,user_id='263ed3799add4cb49d02603007943b46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:36:16 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8209bf2b-5a9d-4c0b-bf74-04e51d435bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:36:16 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8209bf2b-5a9d-4c0b-bf74-04e51d435bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:36:16 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb31427-aa57-483d-86c5-5cf4b7c6ab18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:36:16 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb31427-aa57-483d-86c5-5cf4b7c6ab18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27944bba-8d67-40ac-9561-3ed9608ff92e', 'volume_name': 'volume-27944bba-8d67-40ac-9561-3ed9608ff92e', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:36:16 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af7095f2-1266-47e3-8f45-9a526131a94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:36:16 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af7095f2-1266-47e3-8f45-9a526131a94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:36:16 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778daca6-77dc-481b-b875-da586c3e9a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:36:16 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Volume 27944bba-8d67-40ac-9561-3ed9608ff92e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27944bba-8d67-40ac-9561-3ed9608ff92e', 'volume_size': 1} Apr 29 06:36:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:36:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:36:16 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1561429040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27944bba-8d67-40ac-9561-3ed9608ff92e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dfe40112c894f5b9e937dd7e67337e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:36:16Z,use_quota=True,user_id='263ed3799add4cb49d02603007943b46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:36:16 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Creating volume 27944bba-8d67-40ac-9561-3ed9608ff92e {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:36:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:36:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:36:16 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:36:16 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:36:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:36:16 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:36:16 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:36:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-27944bba-8d67-40ac-9561-3ed9608ff92e 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:16 devstack sudo[84759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-27944bba-8d67-40ac-9561-3ed9608ff92e 1073741824 Apr 29 06:36:16 devstack sudo[84759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:16 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-f75bed36-a3b3-46fb-aac4-e41e32b46940 tempest-GroupsV314Test-79219895 None] Group tempest-GroupsV314Test-Group-173621264: created successfully Apr 29 06:36:16 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-f75bed36-a3b3-46fb-aac4-e41e32b46940 tempest-GroupsV314Test-79219895 None] Create group completed successfully. Apr 29 06:36:18 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:36:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Flow 'volume_create_manager' (07e6fa4c-4116-4eac-91ec-e2951bec84c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:36:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e305bb0-02ce-43b1-b920-40bd624ca931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:36:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e305bb0-02ce-43b1-b920-40bd624ca931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-835282764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=047f6ef5-52e7-46dd-aad9-68f69ddfd478,host='devstack@QuobyteHD#QuobyteHD',id=8ddfecd4-3e95-4f95-8b07-ec35572e4c58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f2976e08544ae9b51744233d76aa71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:36:18Z,use_quota=True,user_id='dfa94bdb43ab4a3181718b1771888179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d2b2db7-607b-4d68-9b90-be255480bedc),volume_type_id=4d2b2db7-607b-4d68-9b90-be255480bedc)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:36:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ef02ef-4dbd-4111-8ff8-02e27f48de91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:36:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ef02ef-4dbd-4111-8ff8-02e27f48de91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:36:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f81d9cab-97b0-478c-b2a1-9be762dc6a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:36:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f81d9cab-97b0-478c-b2a1-9be762dc6a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ddfecd4-3e95-4f95-8b07-ec35572e4c58', 'volume_name': 'volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:36:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10b5e101-609f-467b-80a5-4556c4711c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:36:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10b5e101-609f-467b-80a5-4556c4711c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:36:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24592747-156e-4910-8017-6bffb079fb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:36:18 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Volume 8ddfecd4-3e95-4f95-8b07-ec35572e4c58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58', 'volume_size': 1} Apr 29 06:36:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:36:19 devstack sudo[84759]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-27944bba-8d67-40ac-9561-3ed9608ff92e 1073741824" returned: 0 in 2.780s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-27944bba-8d67-40ac-9561-3ed9608ff92e {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:19 devstack sudo[85102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-27944bba-8d67-40ac-9561-3ed9608ff92e Apr 29 06:36:19 devstack sudo[85102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:20 devstack sudo[85102]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-27944bba-8d67-40ac-9561-3ed9608ff92e" returned: 0 in 1.183s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] <== create_volume: return (4064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:36:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.067s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:36:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.671s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:36:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=047f6ef5-52e7-46dd-aad9-68f69ddfd478,created_at=2026-04-29T04:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-835282764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=047f6ef5-52e7-46dd-aad9-68f69ddfd478,host='devstack@QuobyteHD#QuobyteHD',id=8ddfecd4-3e95-4f95-8b07-ec35572e4c58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f2976e08544ae9b51744233d76aa71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:36:18Z,use_quota=True,user_id='dfa94bdb43ab4a3181718b1771888179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d2b2db7-607b-4d68-9b90-be255480bedc),volume_type_id=4d2b2db7-607b-4d68-9b90-be255480bedc)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:36:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Creating volume 8ddfecd4-3e95-4f95-8b07-ec35572e4c58 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:36:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:36:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:36:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:36:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:36:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:36:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:36:20 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:36:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778daca6-77dc-481b-b875-da586c3e9a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27944bba-8d67-40ac-9561-3ed9608ff92e', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:36:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc4f2c9-57fb-4876-9025-aa9a33d47fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:36:20 devstack sudo[85112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58 1073741824 Apr 29 06:36:20 devstack sudo[85112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:20 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Volume volume-27944bba-8d67-40ac-9561-3ed9608ff92e (27944bba-8d67-40ac-9561-3ed9608ff92e): created successfully Apr 29 06:36:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc4f2c9-57fb-4876-9025-aa9a33d47fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:36:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Flow 'volume_create_manager' (a7459ab0-780b-45a7-a9ca-ede67e640224) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:36:20 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-8b4a9e30-f695-4013-b635-1662cde780da tempest-DeleteServersTestJSON-2116022117 None] Created volume successfully. Apr 29 06:36:21 devstack sudo[85112]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58 1073741824" returned: 0 in 1.398s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:21 devstack sudo[85158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58 Apr 29 06:36:21 devstack sudo[85158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:22 devstack sudo[85158]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58" returned: 0 in 0.675s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] <== create_volume: return (2135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:36:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.138s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:36:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24592747-156e-4910-8017-6bffb079fb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:36:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0b00cc-6294-4edb-ab59-b6715342884b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:36:22 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Volume volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58 (8ddfecd4-3e95-4f95-8b07-ec35572e4c58): created successfully Apr 29 06:36:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0b00cc-6294-4edb-ab59-b6715342884b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:36:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Flow 'volume_create_manager' (07e6fa4c-4116-4eac-91ec-e2951bec84c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:36:22 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-c80bc7be-ea1c-45d8-af86-713cb0e4abc6 tempest-GroupsV314Test-79219895 None] Created volume successfully. Apr 29 06:36:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:36:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.003s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:36:24 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Cloning volume 8ddfecd4-3e95-4f95-8b07-ec35572e4c58 to volume d2db6971-ac8d-49bc-a6d1-88c4f52f28f0 Apr 29 06:36:24 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Creating offline snapshot 0cbb41fa-3b9f-4ed4-b930-77bddd9083a7 of volume 8ddfecd4-3e95-4f95-8b07-ec35572e4c58 {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:36:24 devstack cinder-volume[84195]: INFO oslo.privsep.daemon [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpc7fkythg/privsep.sock'] Apr 29 06:36:24 devstack sudo[85206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpc7fkythg/privsep.sock Apr 29 06:36:24 devstack sudo[85206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:27 devstack sudo[85206]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:27 devstack cinder-volume[84195]: INFO oslo.privsep.daemon [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Spawned new privsep daemon via rootwrap Apr 29 06:36:27 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Accepted privsep connection to /tmp/tmpc7fkythg/privsep.sock {{(pid=84195) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Apr 29 06:36:27 devstack cinder-volume[84195]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 29 06:36:27 devstack cinder-volume[84195]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 29 06:36:27 devstack cinder-volume[84195]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 29 06:36:27 devstack cinder-volume[84195]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85218 Apr 29 06:36:27 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbdd339-2632-41e8-bc7d-d129374e3254]: (2,) {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:36:27 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[3809c26e-0234-4606-bfd6-2d247ebb52cd]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:36:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:27 devstack cinder-volume[84195]: WARNING py.warnings [req-bc002e34-7ac5-444a-b78f-e14c0aaef6a8 req-d9cd103b-5149-4cb0-ba00-006bccbc20f9 tempest-DeleteServersTestJSON-2116022117 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 29 06:36:27 devstack cinder-volume[84195]: .first() Apr 29 06:36:27 devstack cinder-volume[84195]: Apr 29 06:36:27 devstack sudo[85229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58 Apr 29 06:36:27 devstack sudo[85229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-bc002e34-7ac5-444a-b78f-e14c0aaef6a8 req-d9cd103b-5149-4cb0-ba00-006bccbc20f9 tempest-DeleteServersTestJSON-2116022117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:36:28 devstack sudo[85229]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58" returned: 0 in 1.248s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.0cbb41fa-3b9f-4ed4-b930-77bddd9083a7 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:28 devstack sudo[85238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.0cbb41fa-3b9f-4ed4-b930-77bddd9083a7 1G Apr 29 06:36:28 devstack sudo[85238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:29 devstack sudo[85238]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.0cbb41fa-3b9f-4ed4-b930-77bddd9083a7 1G" returned: 0 in 1.473s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.0cbb41fa-3b9f-4ed4-b930-77bddd9083a7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:29 devstack sudo[85245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.0cbb41fa-3b9f-4ed4-b930-77bddd9083a7 Apr 29 06:36:29 devstack sudo[85245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:31 devstack sudo[85245]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.0cbb41fa-3b9f-4ed4-b930-77bddd9083a7" returned: 0 in 1.345s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:31 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.0cbb41fa-3b9f-4ed4-b930-77bddd9083a7 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 06:36:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.0cbb41fa-3b9f-4ed4-b930-77bddd9083a7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:31 devstack sudo[85258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.0cbb41fa-3b9f-4ed4-b930-77bddd9083a7 Apr 29 06:36:31 devstack sudo[85258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:32 devstack sudo[85258]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.0cbb41fa-3b9f-4ed4-b930-77bddd9083a7" returned: 0 in 1.282s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:32 devstack sudo[85295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.info Apr 29 06:36:32 devstack sudo[85295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:33 devstack sudo[85295]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.info" returned: 0 in 0.642s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:33 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 06:36:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:33 devstack sudo[85300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.info Apr 29 06:36:33 devstack sudo[85300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:33 devstack sudo[85300]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.info" returned: 0 in 0.764s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:34 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Acquiring lock "cinder-quobyte-d2db6971-ac8d-49bc-a6d1-88c4f52f28f0" by "_copy_volume_from_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:36:34 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Lock "cinder-quobyte-d2db6971-ac8d-49bc-a6d1-88c4f52f28f0" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:36:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] snapshot: 0cbb41fa-3b9f-4ed4-b930-77bddd9083a7, volume: d2db6971-ac8d-49bc-a6d1-88c4f52f28f0, {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 06:36:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:36:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:36:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:36:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:36:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:36:34 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82eb1f0-0a0f-4f32-8ce2-24b1914780a8]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:36:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.0cbb41fa-3b9f-4ed4-b930-77bddd9083a7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:34 devstack sudo[85305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.0cbb41fa-3b9f-4ed4-b930-77bddd9083a7 Apr 29 06:36:34 devstack sudo[85305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:34 devstack sudo[85305]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.0cbb41fa-3b9f-4ed4-b930-77bddd9083a7" returned: 0 in 0.779s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:36:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58 {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 06:36:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Creating direct copy from snapshot {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 06:36:34 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[321caab6-4a57-4c71-860d-d7c8609efdfb]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:36:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:35 devstack sudo[85313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58 Apr 29 06:36:35 devstack sudo[85313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:35 devstack sudo[85313]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58" returned: 0 in 0.836s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:35 devstack cinder-volume[84195]: DEBUG cinder.utils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Path /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d2db6971-ac8d-49bc-a6d1-88c4f52f28f0 not found in is_blk_device check {{(pid=84195) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 06:36:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d2db6971-ac8d-49bc-a6d1-88c4f52f28f0 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:35 devstack sudo[85318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d2db6971-ac8d-49bc-a6d1-88c4f52f28f0 Apr 29 06:36:35 devstack sudo[85318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:36 devstack cinder-volume[84195]: DEBUG oslo_service.periodic_task [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84195) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 06:36:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:36:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:36:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:36:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:36:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:36:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:36 devstack sudo[85324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:36:36 devstack sudo[85324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:38 devstack sudo[85324]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 1.741s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:38 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:36:41 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:36:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Flow 'volume_create_manager' (16d62e53-7d5c-4f97-805d-d6ee85afcfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:36:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9727bf5-9252-4a30-86e4-ec0a0c3ad4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:36:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9727bf5-9252-4a30-86e4-ec0a0c3ad4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-967508140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e46a0eb6-07ef-4234-8fd9-f91990134761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56483f95f5f44f809f1ca5252b3ceb9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:36:41Z,use_quota=True,user_id='0fc46604e88f4ca2a5599103c1b56d26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:36:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77451b5a-c047-48a1-bda4-6cb27bf1949b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:36:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77451b5a-c047-48a1-bda4-6cb27bf1949b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:36:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6ea8ba-f70c-445c-8e6b-0004921a60f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:36:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6ea8ba-f70c-445c-8e6b-0004921a60f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e46a0eb6-07ef-4234-8fd9-f91990134761', 'volume_name': 'volume-e46a0eb6-07ef-4234-8fd9-f91990134761', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:36:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (204c8315-e8f9-449e-a6bf-d9277bf609ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:36:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (204c8315-e8f9-449e-a6bf-d9277bf609ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:36:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7340575-5f4f-475f-98e1-674b757eee8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:36:41 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Volume e46a0eb6-07ef-4234-8fd9-f91990134761: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e46a0eb6-07ef-4234-8fd9-f91990134761', 'volume_size': 1} Apr 29 06:36:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:36:41 devstack sudo[85318]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d2db6971-ac8d-49bc-a6d1-88c4f52f28f0" returned: 0 in 6.138s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:41 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecd9f09-aba9-44cb-abc2-d5ed8279cf5f]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:36:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:42 devstack sudo[85351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58 Apr 29 06:36:42 devstack sudo[85351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:42 devstack sudo[85351]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58" returned: 0 in 0.932s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:42 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Image conversion details: src /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d2db6971-ac8d-49bc-a6d1-88c4f52f28f0 {{(pid=84195) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 06:36:42 devstack cinder-volume[84195]: INFO cinder.image.image_utils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Converted 1024.00 MB image at 166.80 MB/s Apr 29 06:36:42 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d2db6971-ac8d-49bc-a6d1-88c4f52f28f0 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 06:36:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d2db6971-ac8d-49bc-a6d1-88c4f52f28f0 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:42 devstack sudo[85356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d2db6971-ac8d-49bc-a6d1-88c4f52f28f0 Apr 29 06:36:42 devstack sudo[85356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:43 devstack sudo[85356]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d2db6971-ac8d-49bc-a6d1-88c4f52f28f0" returned: 0 in 0.601s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:43 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Lock "cinder-quobyte-d2db6971-ac8d-49bc-a6d1-88c4f52f28f0" released by "_copy_volume_from_snapshot" :: held 9.415s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:36:43 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Acquiring lock "cinder-quobyte-0cbb41fa-3b9f-4ed4-b930-77bddd9083a7" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:36:43 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Lock "cinder-quobyte-0cbb41fa-3b9f-4ed4-b930-77bddd9083a7" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:36:43 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Deleting offline snapshot 0cbb41fa-3b9f-4ed4-b930-77bddd9083a7 of volume 8ddfecd4-3e95-4f95-8b07-ec35572e4c58 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:36:43 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] snapshot_file for this snap is: volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.0cbb41fa-3b9f-4ed4-b930-77bddd9083a7 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:36:43 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[13529c85-f09f-4158-988a-d8976e1bbab9]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:36:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.0cbb41fa-3b9f-4ed4-b930-77bddd9083a7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:43 devstack sudo[85360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.0cbb41fa-3b9f-4ed4-b930-77bddd9083a7 Apr 29 06:36:43 devstack sudo[85360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:44 devstack sudo[85360]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.0cbb41fa-3b9f-4ed4-b930-77bddd9083a7" returned: 0 in 0.731s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:36:44 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[4779836c-65ec-497a-97b4-ef706d4940aa]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:36:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:44 devstack sudo[85365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58 Apr 29 06:36:44 devstack sudo[85365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:45 devstack sudo[85365]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58" returned: 0 in 0.737s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.0cbb41fa-3b9f-4ed4-b930-77bddd9083a7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:45 devstack sudo[85370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.0cbb41fa-3b9f-4ed4-b930-77bddd9083a7 Apr 29 06:36:45 devstack sudo[85370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:45 devstack sudo[85370]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.0cbb41fa-3b9f-4ed4-b930-77bddd9083a7" returned: 0 in 0.716s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.0cbb41fa-3b9f-4ed4-b930-77bddd9083a7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:45 devstack sudo[85376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.0cbb41fa-3b9f-4ed4-b930-77bddd9083a7 Apr 29 06:36:45 devstack sudo[85376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:46 devstack sudo[85376]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58.0cbb41fa-3b9f-4ed4-b930-77bddd9083a7" returned: 0 in 0.653s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Lock "cinder-quobyte-0cbb41fa-3b9f-4ed4-b930-77bddd9083a7" released by "_delete_snapshot" :: held 2.984s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:36:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.748s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:36:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-bc002e34-7ac5-444a-b78f-e14c0aaef6a8 req-d9cd103b-5149-4cb0-ba00-006bccbc20f9 tempest-DeleteServersTestJSON-2116022117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 19.077s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:36:46 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1200813-eb20-4f12-a4c6-19eae8e5be3c]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:36:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-bc002e34-7ac5-444a-b78f-e14c0aaef6a8 req-d9cd103b-5149-4cb0-ba00-006bccbc20f9 tempest-DeleteServersTestJSON-2116022117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-27944bba-8d67-40ac-9561-3ed9608ff92e {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:46 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-10669014-e7da-47d9-838b-076975134409 tempest-GroupsV314Test-79219895 None] Create group from source-group-047f6ef5-52e7-46dd-aad9-68f69ddfd478 completed successfully. Apr 29 06:36:46 devstack sudo[85383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-27944bba-8d67-40ac-9561-3ed9608ff92e Apr 29 06:36:46 devstack sudo[85383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2bcbec6b-0591-4609-aacb-42606778030a tempest-GroupsV314Test-79219895 None] Acquiring lock "cinder-quobyte-d2db6971-ac8d-49bc-a6d1-88c4f52f28f0" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:36:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2bcbec6b-0591-4609-aacb-42606778030a tempest-GroupsV314Test-79219895 None] Lock "cinder-quobyte-d2db6971-ac8d-49bc-a6d1-88c4f52f28f0" acquired by "delete_volume" :: waited 0.021s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:36:47 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[17430c6b-ad0a-4c07-9a70-44093ec96323]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:36:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2bcbec6b-0591-4609-aacb-42606778030a tempest-GroupsV314Test-79219895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d2db6971-ac8d-49bc-a6d1-88c4f52f28f0 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:47 devstack sudo[85383]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-bc002e34-7ac5-444a-b78f-e14c0aaef6a8 req-d9cd103b-5149-4cb0-ba00-006bccbc20f9 tempest-DeleteServersTestJSON-2116022117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-27944bba-8d67-40ac-9561-3ed9608ff92e" returned: 0 in 0.916s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-bc002e34-7ac5-444a-b78f-e14c0aaef6a8 req-d9cd103b-5149-4cb0-ba00-006bccbc20f9 tempest-DeleteServersTestJSON-2116022117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.944s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:36:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.171s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:36:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-967508140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e46a0eb6-07ef-4234-8fd9-f91990134761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56483f95f5f44f809f1ca5252b3ceb9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:36:41Z,use_quota=True,user_id='0fc46604e88f4ca2a5599103c1b56d26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:36:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Creating volume e46a0eb6-07ef-4234-8fd9-f91990134761 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:36:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:36:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:36:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:36:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:36:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:36:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:36:47 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:36:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e46a0eb6-07ef-4234-8fd9-f91990134761 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:47 devstack sudo[85389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d2db6971-ac8d-49bc-a6d1-88c4f52f28f0 Apr 29 06:36:47 devstack sudo[85389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:47 devstack sudo[85390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e46a0eb6-07ef-4234-8fd9-f91990134761 1073741824 Apr 29 06:36:47 devstack sudo[85390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-bc002e34-7ac5-444a-b78f-e14c0aaef6a8 req-d9cd103b-5149-4cb0-ba00-006bccbc20f9 tempest-DeleteServersTestJSON-2116022117 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9', 'name': 'volume-27944bba-8d67-40ac-9561-3ed9608ff92e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'df5927e0-f9d1-47d7-b90d-3cd6feb6ed85', 'enforce_multipath': True} {{(pid=84195) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 06:36:47 devstack cinder-volume[84195]: INFO cinder.volume.manager [req-bc002e34-7ac5-444a-b78f-e14c0aaef6a8 req-d9cd103b-5149-4cb0-ba00-006bccbc20f9 tempest-DeleteServersTestJSON-2116022117 None] attachment_update completed successfully. Apr 29 06:36:48 devstack sudo[85389]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2bcbec6b-0591-4609-aacb-42606778030a tempest-GroupsV314Test-79219895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d2db6971-ac8d-49bc-a6d1-88c4f52f28f0" returned: 0 in 1.194s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2bcbec6b-0591-4609-aacb-42606778030a tempest-GroupsV314Test-79219895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d2db6971-ac8d-49bc-a6d1-88c4f52f28f0 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:48 devstack sudo[85465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d2db6971-ac8d-49bc-a6d1-88c4f52f28f0 Apr 29 06:36:48 devstack sudo[85465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:48 devstack sudo[85390]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e46a0eb6-07ef-4234-8fd9-f91990134761 1073741824" returned: 0 in 1.289s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e46a0eb6-07ef-4234-8fd9-f91990134761 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:48 devstack sudo[85469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e46a0eb6-07ef-4234-8fd9-f91990134761 Apr 29 06:36:48 devstack sudo[85469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:49 devstack sudo[85465]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2bcbec6b-0591-4609-aacb-42606778030a tempest-GroupsV314Test-79219895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d2db6971-ac8d-49bc-a6d1-88c4f52f28f0" returned: 0 in 0.826s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:49 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2bcbec6b-0591-4609-aacb-42606778030a tempest-GroupsV314Test-79219895 None] Lock "cinder-quobyte-d2db6971-ac8d-49bc-a6d1-88c4f52f28f0" released by "delete_volume" :: held 2.100s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:36:49 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-2bcbec6b-0591-4609-aacb-42606778030a tempest-GroupsV314Test-79219895 None] Created reservations ['bf537e8d-1f69-42ab-926b-725ceb479884'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:36:49 devstack cinder-volume[84195]: WARNING cinder.quota [None req-2bcbec6b-0591-4609-aacb-42606778030a tempest-GroupsV314Test-79219895 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-901026535 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-901026535, it is now deprecated. Please use the default quota class for default quota. Apr 29 06:36:49 devstack cinder-volume[84195]: WARNING cinder.quota [None req-2bcbec6b-0591-4609-aacb-42606778030a tempest-GroupsV314Test-79219895 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-901026535 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-901026535, it is now deprecated. Please use the default quota class for default quota. Apr 29 06:36:49 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-2bcbec6b-0591-4609-aacb-42606778030a tempest-GroupsV314Test-79219895 None] Created reservations ['1626cad0-0069-4aac-9b14-04a2ac25c889', '5a99ed2c-90cf-48b0-bfcd-1e75e9de48d7', '71c1e327-ca65-4fef-b2a3-35c8128d4d3b', 'e4c08e30-bb52-4020-8fc6-6645fd0d5342'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:36:49 devstack sudo[85469]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e46a0eb6-07ef-4234-8fd9-f91990134761" returned: 0 in 0.857s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] <== create_volume: return (2210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:36:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.213s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:36:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7340575-5f4f-475f-98e1-674b757eee8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e46a0eb6-07ef-4234-8fd9-f91990134761', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:36:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd5dbcae-21a4-4cf0-9dfd-7cafa29d99ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:36:49 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Volume volume-e46a0eb6-07ef-4234-8fd9-f91990134761 (e46a0eb6-07ef-4234-8fd9-f91990134761): created successfully Apr 29 06:36:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd5dbcae-21a4-4cf0-9dfd-7cafa29d99ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:36:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Flow 'volume_create_manager' (16d62e53-7d5c-4f97-805d-d6ee85afcfbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:36:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2bcbec6b-0591-4609-aacb-42606778030a tempest-GroupsV314Test-79219895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:36:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2bcbec6b-0591-4609-aacb-42606778030a tempest-GroupsV314Test-79219895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:36:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2bcbec6b-0591-4609-aacb-42606778030a tempest-GroupsV314Test-79219895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:36:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2bcbec6b-0591-4609-aacb-42606778030a tempest-GroupsV314Test-79219895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:36:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2bcbec6b-0591-4609-aacb-42606778030a tempest-GroupsV314Test-79219895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:36:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2bcbec6b-0591-4609-aacb-42606778030a tempest-GroupsV314Test-79219895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:49 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-9c87496e-62e5-4a52-b329-4f3de72a1c13 tempest-ServersNegativeTestJSON-234348729 None] Created volume successfully. Apr 29 06:36:49 devstack sudo[85788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:36:49 devstack sudo[85788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:50 devstack sudo[85788]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2bcbec6b-0591-4609-aacb-42606778030a tempest-GroupsV314Test-79219895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.691s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:50 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-2bcbec6b-0591-4609-aacb-42606778030a tempest-GroupsV314Test-79219895 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:36:50 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-2bcbec6b-0591-4609-aacb-42606778030a tempest-GroupsV314Test-79219895 None] Delete group completed successfully. Apr 29 06:36:51 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-45656ba5-64f9-4acc-8d6d-a9c6d09d69e3 tempest-GroupsV314Test-79219895 None] Acquiring lock "cinder-quobyte-8ddfecd4-3e95-4f95-8b07-ec35572e4c58" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:36:51 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-45656ba5-64f9-4acc-8d6d-a9c6d09d69e3 tempest-GroupsV314Test-79219895 None] Lock "cinder-quobyte-8ddfecd4-3e95-4f95-8b07-ec35572e4c58" acquired by "delete_volume" :: waited 0.030s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:36:51 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6ac068-2f03-4fb1-b2c4-9f78b4de9931]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:36:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-45656ba5-64f9-4acc-8d6d-a9c6d09d69e3 tempest-GroupsV314Test-79219895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:51 devstack sudo[85791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58 Apr 29 06:36:51 devstack sudo[85791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:51 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:36:51 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Flow 'volume_create_manager' (5adfa3d9-3712-47e0-b020-3b2f10529ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:36:51 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (911ce2c6-7bc7-4ae4-b234-4f4820221b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:36:51 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (911ce2c6-7bc7-4ae4-b234-4f4820221b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-558921548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da76cee8-786e-4375-b8c8-b975900567e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56483f95f5f44f809f1ca5252b3ceb9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:36:52Z,use_quota=True,user_id='0fc46604e88f4ca2a5599103c1b56d26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:36:51 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda8a630-289a-4d44-9ae0-ec130a1bc590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:36:51 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda8a630-289a-4d44-9ae0-ec130a1bc590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:36:51 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d87f57-134a-4dc2-9398-7b61cd6b3438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:36:51 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d87f57-134a-4dc2-9398-7b61cd6b3438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da76cee8-786e-4375-b8c8-b975900567e5', 'volume_name': 'volume-da76cee8-786e-4375-b8c8-b975900567e5', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:36:51 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5585f328-c9af-4437-b1b6-d79ea76f7070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:36:51 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5585f328-c9af-4437-b1b6-d79ea76f7070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:36:51 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac65c2c-3883-442a-b7f6-7f1071b9ef8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:36:51 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Volume da76cee8-786e-4375-b8c8-b975900567e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da76cee8-786e-4375-b8c8-b975900567e5', 'volume_size': 1} Apr 29 06:36:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:36:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:36:51 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-558921548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da76cee8-786e-4375-b8c8-b975900567e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56483f95f5f44f809f1ca5252b3ceb9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:36:52Z,use_quota=True,user_id='0fc46604e88f4ca2a5599103c1b56d26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:36:51 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Creating volume da76cee8-786e-4375-b8c8-b975900567e5 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:36:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:36:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:36:51 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:36:51 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:36:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:36:51 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:36:51 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:36:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-da76cee8-786e-4375-b8c8-b975900567e5 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:51 devstack sudo[85793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-da76cee8-786e-4375-b8c8-b975900567e5 1073741824 Apr 29 06:36:51 devstack sudo[85793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:52 devstack sudo[85791]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-45656ba5-64f9-4acc-8d6d-a9c6d09d69e3 tempest-GroupsV314Test-79219895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58" returned: 0 in 0.872s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-45656ba5-64f9-4acc-8d6d-a9c6d09d69e3 tempest-GroupsV314Test-79219895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:52 devstack sudo[85798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58 Apr 29 06:36:52 devstack sudo[85798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:52 devstack sudo[85798]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-45656ba5-64f9-4acc-8d6d-a9c6d09d69e3 tempest-GroupsV314Test-79219895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8ddfecd4-3e95-4f95-8b07-ec35572e4c58" returned: 0 in 0.730s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:52 devstack sudo[85793]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-da76cee8-786e-4375-b8c8-b975900567e5 1073741824" returned: 0 in 1.060s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:52 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-45656ba5-64f9-4acc-8d6d-a9c6d09d69e3 tempest-GroupsV314Test-79219895 None] Lock "cinder-quobyte-8ddfecd4-3e95-4f95-8b07-ec35572e4c58" released by "delete_volume" :: held 1.691s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:36:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-da76cee8-786e-4375-b8c8-b975900567e5 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:52 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-45656ba5-64f9-4acc-8d6d-a9c6d09d69e3 tempest-GroupsV314Test-79219895 None] Created reservations ['d9f8e004-475b-40fd-8a8e-e9d2b40bb747'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:36:52 devstack sudo[85806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-da76cee8-786e-4375-b8c8-b975900567e5 Apr 29 06:36:52 devstack sudo[85806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:53 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-45656ba5-64f9-4acc-8d6d-a9c6d09d69e3 tempest-GroupsV314Test-79219895 None] Created reservations ['3c4bd3f8-a983-47cb-a63c-45e23f85bd9a', '081a7c26-c727-4ed1-bd52-d2de0e51654d', '3f73c43a-f72a-414c-ac1b-62886ad97bad', '85188cb2-d524-466a-b720-f4cbf1ea32b1'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:36:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-45656ba5-64f9-4acc-8d6d-a9c6d09d69e3 tempest-GroupsV314Test-79219895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:36:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-45656ba5-64f9-4acc-8d6d-a9c6d09d69e3 tempest-GroupsV314Test-79219895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:36:53 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-45656ba5-64f9-4acc-8d6d-a9c6d09d69e3 tempest-GroupsV314Test-79219895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:36:53 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-45656ba5-64f9-4acc-8d6d-a9c6d09d69e3 tempest-GroupsV314Test-79219895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:36:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-45656ba5-64f9-4acc-8d6d-a9c6d09d69e3 tempest-GroupsV314Test-79219895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:36:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-45656ba5-64f9-4acc-8d6d-a9c6d09d69e3 tempest-GroupsV314Test-79219895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:53 devstack sudo[85808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:36:53 devstack sudo[85808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:53 devstack sudo[85806]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-da76cee8-786e-4375-b8c8-b975900567e5" returned: 0 in 0.712s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:53 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:36:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:36:53 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac65c2c-3883-442a-b7f6-7f1071b9ef8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da76cee8-786e-4375-b8c8-b975900567e5', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:36:53 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b1232cc-692b-472e-8690-62e966150190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:36:53 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Volume volume-da76cee8-786e-4375-b8c8-b975900567e5 (da76cee8-786e-4375-b8c8-b975900567e5): created successfully Apr 29 06:36:53 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b1232cc-692b-472e-8690-62e966150190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:36:53 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Flow 'volume_create_manager' (5adfa3d9-3712-47e0-b020-3b2f10529ee4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:36:53 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-112c7f46-bfa3-44b7-9baa-b4458d6b58f6 tempest-ServersNegativeTestJSON-234348729 None] Created volume successfully. Apr 29 06:36:54 devstack sudo[85808]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-45656ba5-64f9-4acc-8d6d-a9c6d09d69e3 tempest-GroupsV314Test-79219895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 1.180s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:54 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-45656ba5-64f9-4acc-8d6d-a9c6d09d69e3 tempest-GroupsV314Test-79219895 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:36:54 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-45656ba5-64f9-4acc-8d6d-a9c6d09d69e3 tempest-GroupsV314Test-79219895 None] Delete group completed successfully. Apr 29 06:36:54 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-cc90fa62-6cdf-490d-a581-a26bd3ed8403 tempest-ServersNegativeTestJSON-234348729 None] Acquiring lock "cinder-da76cee8-786e-4375-b8c8-b975900567e5-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:36:54 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-cc90fa62-6cdf-490d-a581-a26bd3ed8403 tempest-ServersNegativeTestJSON-234348729 None] Lock "cinder-da76cee8-786e-4375-b8c8-b975900567e5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:36:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-cc90fa62-6cdf-490d-a581-a26bd3ed8403 tempest-ServersNegativeTestJSON-234348729 None] Acquiring lock "cinder-quobyte-da76cee8-786e-4375-b8c8-b975900567e5" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:36:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-cc90fa62-6cdf-490d-a581-a26bd3ed8403 tempest-ServersNegativeTestJSON-234348729 None] Lock "cinder-quobyte-da76cee8-786e-4375-b8c8-b975900567e5" acquired by "delete_volume" :: waited 0.016s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:36:55 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e795d8-8edb-4d32-a0cb-806ef5a596c3]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:36:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-cc90fa62-6cdf-490d-a581-a26bd3ed8403 tempest-ServersNegativeTestJSON-234348729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-da76cee8-786e-4375-b8c8-b975900567e5 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:55 devstack sudo[85877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-da76cee8-786e-4375-b8c8-b975900567e5 Apr 29 06:36:55 devstack sudo[85877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:55 devstack sudo[85877]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-cc90fa62-6cdf-490d-a581-a26bd3ed8403 tempest-ServersNegativeTestJSON-234348729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-da76cee8-786e-4375-b8c8-b975900567e5" returned: 0 in 0.877s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-cc90fa62-6cdf-490d-a581-a26bd3ed8403 tempest-ServersNegativeTestJSON-234348729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-da76cee8-786e-4375-b8c8-b975900567e5 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:56 devstack sudo[85884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-da76cee8-786e-4375-b8c8-b975900567e5 Apr 29 06:36:56 devstack sudo[85884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:56 devstack sudo[85884]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-cc90fa62-6cdf-490d-a581-a26bd3ed8403 tempest-ServersNegativeTestJSON-234348729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-da76cee8-786e-4375-b8c8-b975900567e5" returned: 0 in 0.705s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:56 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-cc90fa62-6cdf-490d-a581-a26bd3ed8403 tempest-ServersNegativeTestJSON-234348729 None] Lock "cinder-quobyte-da76cee8-786e-4375-b8c8-b975900567e5" released by "delete_volume" :: held 1.642s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:36:56 devstack cinder-volume[84195]: WARNING cinder.quota [None req-cc90fa62-6cdf-490d-a581-a26bd3ed8403 tempest-ServersNegativeTestJSON-234348729 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 06:36:56 devstack cinder-volume[84195]: WARNING cinder.quota [None req-cc90fa62-6cdf-490d-a581-a26bd3ed8403 tempest-ServersNegativeTestJSON-234348729 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 06:36:56 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-cc90fa62-6cdf-490d-a581-a26bd3ed8403 tempest-ServersNegativeTestJSON-234348729 None] Created reservations ['f3a471ac-dfb2-42c9-9687-75678d781dc7', '45891ea3-91fe-48a9-aea5-286a4ce9b195', 'd44ef658-13e2-43d9-809e-b719adeba896', 'e8901bb0-de89-4153-876a-66b808086a75'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:36:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-cc90fa62-6cdf-490d-a581-a26bd3ed8403 tempest-ServersNegativeTestJSON-234348729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:36:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-cc90fa62-6cdf-490d-a581-a26bd3ed8403 tempest-ServersNegativeTestJSON-234348729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:36:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-cc90fa62-6cdf-490d-a581-a26bd3ed8403 tempest-ServersNegativeTestJSON-234348729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:36:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-cc90fa62-6cdf-490d-a581-a26bd3ed8403 tempest-ServersNegativeTestJSON-234348729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:36:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-cc90fa62-6cdf-490d-a581-a26bd3ed8403 tempest-ServersNegativeTestJSON-234348729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:36:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-cc90fa62-6cdf-490d-a581-a26bd3ed8403 tempest-ServersNegativeTestJSON-234348729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:56 devstack sudo[85888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:36:56 devstack sudo[85888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:57 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-fcadfabd-f1b5-430b-aaad-bc92fcaf8f2f tempest-ServersNegativeTestJSON-234348729 None] Acquiring lock "cinder-e46a0eb6-07ef-4234-8fd9-f91990134761-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:36:57 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-fcadfabd-f1b5-430b-aaad-bc92fcaf8f2f tempest-ServersNegativeTestJSON-234348729 None] Lock "cinder-e46a0eb6-07ef-4234-8fd9-f91990134761-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:36:57 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-fcadfabd-f1b5-430b-aaad-bc92fcaf8f2f tempest-ServersNegativeTestJSON-234348729 None] Acquiring lock "cinder-quobyte-e46a0eb6-07ef-4234-8fd9-f91990134761" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:36:57 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-fcadfabd-f1b5-430b-aaad-bc92fcaf8f2f tempest-ServersNegativeTestJSON-234348729 None] Lock "cinder-quobyte-e46a0eb6-07ef-4234-8fd9-f91990134761" acquired by "delete_volume" :: waited 0.041s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:36:57 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[78467c11-04a2-47e0-94d3-cbded3cabbd1]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:36:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-fcadfabd-f1b5-430b-aaad-bc92fcaf8f2f tempest-ServersNegativeTestJSON-234348729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e46a0eb6-07ef-4234-8fd9-f91990134761 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:57 devstack sudo[85891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e46a0eb6-07ef-4234-8fd9-f91990134761 Apr 29 06:36:57 devstack sudo[85891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:57 devstack sudo[85888]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-cc90fa62-6cdf-490d-a581-a26bd3ed8403 tempest-ServersNegativeTestJSON-234348729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.882s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:57 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-cc90fa62-6cdf-490d-a581-a26bd3ed8403 tempest-ServersNegativeTestJSON-234348729 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:36:57 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-cc90fa62-6cdf-490d-a581-a26bd3ed8403 tempest-ServersNegativeTestJSON-234348729 None] Deleted volume successfully. Apr 29 06:36:57 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-cc90fa62-6cdf-490d-a581-a26bd3ed8403 tempest-ServersNegativeTestJSON-234348729 None] Lock "cinder-da76cee8-786e-4375-b8c8-b975900567e5-delete_volume" released by "delete_volume" :: held 2.792s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:36:58 devstack sudo[85891]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-fcadfabd-f1b5-430b-aaad-bc92fcaf8f2f tempest-ServersNegativeTestJSON-234348729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e46a0eb6-07ef-4234-8fd9-f91990134761" returned: 0 in 0.766s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-fcadfabd-f1b5-430b-aaad-bc92fcaf8f2f tempest-ServersNegativeTestJSON-234348729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e46a0eb6-07ef-4234-8fd9-f91990134761 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:58 devstack sudo[85897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e46a0eb6-07ef-4234-8fd9-f91990134761 Apr 29 06:36:58 devstack sudo[85897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:59 devstack sudo[85897]: pam_unix(sudo:session): session closed for user root Apr 29 06:36:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-fcadfabd-f1b5-430b-aaad-bc92fcaf8f2f tempest-ServersNegativeTestJSON-234348729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e46a0eb6-07ef-4234-8fd9-f91990134761" returned: 0 in 0.761s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:36:59 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-fcadfabd-f1b5-430b-aaad-bc92fcaf8f2f tempest-ServersNegativeTestJSON-234348729 None] Lock "cinder-quobyte-e46a0eb6-07ef-4234-8fd9-f91990134761" released by "delete_volume" :: held 1.588s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:36:59 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-fcadfabd-f1b5-430b-aaad-bc92fcaf8f2f tempest-ServersNegativeTestJSON-234348729 None] Created reservations ['07f3c275-5fd5-4d75-8679-eeca1256ee34', 'c581bd73-136f-4896-b429-2edfd536244b', '94bb4225-43f7-49b5-8178-b17069226fed', '8daa7206-67c9-45be-ad14-05dea52e63f6'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:36:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-fcadfabd-f1b5-430b-aaad-bc92fcaf8f2f tempest-ServersNegativeTestJSON-234348729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:36:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-fcadfabd-f1b5-430b-aaad-bc92fcaf8f2f tempest-ServersNegativeTestJSON-234348729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:36:59 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-fcadfabd-f1b5-430b-aaad-bc92fcaf8f2f tempest-ServersNegativeTestJSON-234348729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:36:59 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-fcadfabd-f1b5-430b-aaad-bc92fcaf8f2f tempest-ServersNegativeTestJSON-234348729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:36:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-fcadfabd-f1b5-430b-aaad-bc92fcaf8f2f tempest-ServersNegativeTestJSON-234348729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:36:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-fcadfabd-f1b5-430b-aaad-bc92fcaf8f2f tempest-ServersNegativeTestJSON-234348729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:36:59 devstack sudo[85902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:36:59 devstack sudo[85902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:36:59 devstack cinder-volume[84195]: INFO cinder.volume.manager [req-df54777c-8228-4f23-83e6-64bcbc41d205 req-192d1eab-f05a-4cfc-89be-2427991254ae tempest-DeleteServersTestJSON-2116022117 None] Terminate volume connection completed successfully. Apr 29 06:36:59 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-df54777c-8228-4f23-83e6-64bcbc41d205 req-192d1eab-f05a-4cfc-89be-2427991254ae tempest-DeleteServersTestJSON-2116022117 None] Deleting attachment df5927e0-f9d1-47d7-b90d-3cd6feb6ed85. {{(pid=84195) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 06:37:00 devstack sudo[85902]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-fcadfabd-f1b5-430b-aaad-bc92fcaf8f2f tempest-ServersNegativeTestJSON-234348729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.969s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:00 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-fcadfabd-f1b5-430b-aaad-bc92fcaf8f2f tempest-ServersNegativeTestJSON-234348729 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:37:00 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-fcadfabd-f1b5-430b-aaad-bc92fcaf8f2f tempest-ServersNegativeTestJSON-234348729 None] Deleted volume successfully. Apr 29 06:37:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-fcadfabd-f1b5-430b-aaad-bc92fcaf8f2f tempest-ServersNegativeTestJSON-234348729 None] Lock "cinder-e46a0eb6-07ef-4234-8fd9-f91990134761-delete_volume" released by "delete_volume" :: held 2.893s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:37:03 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-28fadee8-54ac-47cf-84a1-9c31d373f365 tempest-DeleteServersTestJSON-2116022117 None] Acquiring lock "cinder-27944bba-8d67-40ac-9561-3ed9608ff92e-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:37:03 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-28fadee8-54ac-47cf-84a1-9c31d373f365 tempest-DeleteServersTestJSON-2116022117 None] Lock "cinder-27944bba-8d67-40ac-9561-3ed9608ff92e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:37:03 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-28fadee8-54ac-47cf-84a1-9c31d373f365 tempest-DeleteServersTestJSON-2116022117 None] Acquiring lock "cinder-quobyte-27944bba-8d67-40ac-9561-3ed9608ff92e" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:37:03 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-28fadee8-54ac-47cf-84a1-9c31d373f365 tempest-DeleteServersTestJSON-2116022117 None] Lock "cinder-quobyte-27944bba-8d67-40ac-9561-3ed9608ff92e" acquired by "delete_volume" :: waited 0.017s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:37:03 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[a923d8f1-fd2c-495d-bd5b-0f36e665e985]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:37:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-28fadee8-54ac-47cf-84a1-9c31d373f365 tempest-DeleteServersTestJSON-2116022117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-27944bba-8d67-40ac-9561-3ed9608ff92e {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:03 devstack sudo[85945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-27944bba-8d67-40ac-9561-3ed9608ff92e Apr 29 06:37:03 devstack sudo[85945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:04 devstack sudo[85945]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-28fadee8-54ac-47cf-84a1-9c31d373f365 tempest-DeleteServersTestJSON-2116022117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-27944bba-8d67-40ac-9561-3ed9608ff92e" returned: 0 in 0.823s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-28fadee8-54ac-47cf-84a1-9c31d373f365 tempest-DeleteServersTestJSON-2116022117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-27944bba-8d67-40ac-9561-3ed9608ff92e {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:04 devstack sudo[85951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-27944bba-8d67-40ac-9561-3ed9608ff92e Apr 29 06:37:04 devstack sudo[85951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:05 devstack sudo[85951]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-28fadee8-54ac-47cf-84a1-9c31d373f365 tempest-DeleteServersTestJSON-2116022117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-27944bba-8d67-40ac-9561-3ed9608ff92e" returned: 0 in 0.760s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:05 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-28fadee8-54ac-47cf-84a1-9c31d373f365 tempest-DeleteServersTestJSON-2116022117 None] Lock "cinder-quobyte-27944bba-8d67-40ac-9561-3ed9608ff92e" released by "delete_volume" :: held 1.642s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:37:05 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-28fadee8-54ac-47cf-84a1-9c31d373f365 tempest-DeleteServersTestJSON-2116022117 None] Created reservations ['9c9f9792-1f5d-46d6-94e7-256348e32448', 'b9d2f06b-8fcc-40c2-9f7b-2815ff97c8ae', '4810bd68-bfb3-49f8-a731-c804bac77240', '7c6e1d93-cd57-4f18-85a0-ddd3f9043f08'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:37:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-28fadee8-54ac-47cf-84a1-9c31d373f365 tempest-DeleteServersTestJSON-2116022117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:37:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-28fadee8-54ac-47cf-84a1-9c31d373f365 tempest-DeleteServersTestJSON-2116022117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:37:05 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-28fadee8-54ac-47cf-84a1-9c31d373f365 tempest-DeleteServersTestJSON-2116022117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:37:05 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-28fadee8-54ac-47cf-84a1-9c31d373f365 tempest-DeleteServersTestJSON-2116022117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:37:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-28fadee8-54ac-47cf-84a1-9c31d373f365 tempest-DeleteServersTestJSON-2116022117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:37:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-28fadee8-54ac-47cf-84a1-9c31d373f365 tempest-DeleteServersTestJSON-2116022117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:05 devstack sudo[85954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:37:05 devstack sudo[85954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:06 devstack sudo[85954]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-28fadee8-54ac-47cf-84a1-9c31d373f365 tempest-DeleteServersTestJSON-2116022117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.720s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:06 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-28fadee8-54ac-47cf-84a1-9c31d373f365 tempest-DeleteServersTestJSON-2116022117 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:37:06 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-28fadee8-54ac-47cf-84a1-9c31d373f365 tempest-DeleteServersTestJSON-2116022117 None] Deleted volume successfully. Apr 29 06:37:06 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-28fadee8-54ac-47cf-84a1-9c31d373f365 tempest-DeleteServersTestJSON-2116022117 None] Lock "cinder-27944bba-8d67-40ac-9561-3ed9608ff92e-delete_volume" released by "delete_volume" :: held 2.635s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:37:15 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:SELECT=62,cinder:UPDATE=69,cinder:INSERT=17,cinder:DELETE=1 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:37:16 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:UPDATE=58,cinder:SELECT=51,cinder:INSERT=11,cinder:DELETE=6 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:37:20 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-c05e0743-fab0-4099-a317-8afbd4bfb91a tempest-GroupsV320Test-1987933661 None] Group tempest-GroupsV320Test-Group-960199019: creating Apr 29 06:37:20 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-c05e0743-fab0-4099-a317-8afbd4bfb91a tempest-GroupsV320Test-1987933661 None] Group tempest-GroupsV320Test-Group-960199019: created successfully Apr 29 06:37:20 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-c05e0743-fab0-4099-a317-8afbd4bfb91a tempest-GroupsV320Test-1987933661 None] Create group completed successfully. Apr 29 06:37:21 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-10551aea-a0cd-4f4d-b762-c5ac4a477f6f tempest-GroupsV320Test-1987933661 None] Created reservations ['eb6356cc-06b5-46cb-8bfb-96c3d6cf2036'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:37:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-10551aea-a0cd-4f4d-b762-c5ac4a477f6f tempest-GroupsV320Test-1987933661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:37:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-10551aea-a0cd-4f4d-b762-c5ac4a477f6f tempest-GroupsV320Test-1987933661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:37:21 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-10551aea-a0cd-4f4d-b762-c5ac4a477f6f tempest-GroupsV320Test-1987933661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:37:21 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-10551aea-a0cd-4f4d-b762-c5ac4a477f6f tempest-GroupsV320Test-1987933661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:37:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-10551aea-a0cd-4f4d-b762-c5ac4a477f6f tempest-GroupsV320Test-1987933661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:37:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10551aea-a0cd-4f4d-b762-c5ac4a477f6f tempest-GroupsV320Test-1987933661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:21 devstack sudo[86007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:37:21 devstack sudo[86007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:22 devstack sudo[86007]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10551aea-a0cd-4f4d-b762-c5ac4a477f6f tempest-GroupsV320Test-1987933661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.867s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:22 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-10551aea-a0cd-4f4d-b762-c5ac4a477f6f tempest-GroupsV320Test-1987933661 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:37:22 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-10551aea-a0cd-4f4d-b762-c5ac4a477f6f tempest-GroupsV320Test-1987933661 None] Delete group completed successfully. Apr 29 06:37:25 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:37:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Flow 'volume_create_manager' (4577585f-1027-4f81-9eef-62ad27a3ae2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:37:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92358039-75be-4ed0-a0d8-71738b209bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:37:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92358039-75be-4ed0-a0d8-71738b209bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1357166338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9fb565b-0372-4c35-8f11-29b75cca81ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d432758d984a54a32d21ac9980de25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:37:25Z,use_quota=True,user_id='abd4cf847f1b4b928a9cfcf51cbe4386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:37:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d0c0ee-7172-4462-b816-2d7c3d1e8e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:37:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d0c0ee-7172-4462-b816-2d7c3d1e8e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:37:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c87be0c9-a391-4437-a20c-de041f492434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:37:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c87be0c9-a391-4437-a20c-de041f492434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9fb565b-0372-4c35-8f11-29b75cca81ea', 'volume_name': 'volume-b9fb565b-0372-4c35-8f11-29b75cca81ea', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:37:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae8c7f4-5d57-4bfb-a6d5-6514c819f650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:37:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae8c7f4-5d57-4bfb-a6d5-6514c819f650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:37:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af6891ad-39ba-4a97-82a1-28cf07b1fef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:37:25 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Volume b9fb565b-0372-4c35-8f11-29b75cca81ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9fb565b-0372-4c35-8f11-29b75cca81ea', 'volume_size': 1} Apr 29 06:37:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:37:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:37:25 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1357166338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9fb565b-0372-4c35-8f11-29b75cca81ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d432758d984a54a32d21ac9980de25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:37:25Z,use_quota=True,user_id='abd4cf847f1b4b928a9cfcf51cbe4386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:37:25 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Creating volume b9fb565b-0372-4c35-8f11-29b75cca81ea {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:37:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:37:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:37:25 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:37:25 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:37:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:37:25 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:37:25 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:37:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:25 devstack sudo[86013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea 1073741824 Apr 29 06:37:25 devstack sudo[86013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:26 devstack sudo[86013]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea 1073741824" returned: 0 in 0.974s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:26 devstack sudo[86021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea Apr 29 06:37:26 devstack sudo[86021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:27 devstack sudo[86021]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea" returned: 0 in 0.917s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:27 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] <== create_volume: return (1959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:37:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.966s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:37:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af6891ad-39ba-4a97-82a1-28cf07b1fef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9fb565b-0372-4c35-8f11-29b75cca81ea', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:37:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d91c8473-f926-4301-8085-c5b14b25cf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:37:27 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Volume volume-b9fb565b-0372-4c35-8f11-29b75cca81ea (b9fb565b-0372-4c35-8f11-29b75cca81ea): created successfully Apr 29 06:37:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d91c8473-f926-4301-8085-c5b14b25cf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:37:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Flow 'volume_create_manager' (4577585f-1027-4f81-9eef-62ad27a3ae2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:37:27 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-89f5877f-554b-4b4a-9806-bc3d0d3fac97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Created volume successfully. Apr 29 06:37:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f4a7a5a2-a7bf-469a-9e49-a3db203b5dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:37:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f4a7a5a2-a7bf-469a-9e49-a3db203b5dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:37:29 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-f4a7a5a2-a7bf-469a-9e49-a3db203b5dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Creating offline snapshot cd9da9f1-2bef-426e-b75e-b49ee60f163a of volume b9fb565b-0372-4c35-8f11-29b75cca81ea {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:37:29 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c21341-1c0a-498f-9857-7089e97f9d0c]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:37:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f4a7a5a2-a7bf-469a-9e49-a3db203b5dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:29 devstack sudo[86041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea Apr 29 06:37:29 devstack sudo[86041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:30 devstack sudo[86041]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f4a7a5a2-a7bf-469a-9e49-a3db203b5dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea" returned: 0 in 0.773s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f4a7a5a2-a7bf-469a-9e49-a3db203b5dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea.cd9da9f1-2bef-426e-b75e-b49ee60f163a 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:30 devstack sudo[86049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea.cd9da9f1-2bef-426e-b75e-b49ee60f163a 1G Apr 29 06:37:30 devstack sudo[86049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:31 devstack sudo[86049]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f4a7a5a2-a7bf-469a-9e49-a3db203b5dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea.cd9da9f1-2bef-426e-b75e-b49ee60f163a 1G" returned: 0 in 0.978s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f4a7a5a2-a7bf-469a-9e49-a3db203b5dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9fb565b-0372-4c35-8f11-29b75cca81ea -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea.cd9da9f1-2bef-426e-b75e-b49ee60f163a {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:31 devstack sudo[86055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9fb565b-0372-4c35-8f11-29b75cca81ea -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea.cd9da9f1-2bef-426e-b75e-b49ee60f163a Apr 29 06:37:31 devstack sudo[86055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:32 devstack sudo[86055]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f4a7a5a2-a7bf-469a-9e49-a3db203b5dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9fb565b-0372-4c35-8f11-29b75cca81ea -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea.cd9da9f1-2bef-426e-b75e-b49ee60f163a" returned: 0 in 0.916s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:32 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-f4a7a5a2-a7bf-469a-9e49-a3db203b5dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea.cd9da9f1-2bef-426e-b75e-b49ee60f163a is being set with open permissions: ugo+rw Apr 29 06:37:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f4a7a5a2-a7bf-469a-9e49-a3db203b5dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea.cd9da9f1-2bef-426e-b75e-b49ee60f163a {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:32 devstack sudo[86068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea.cd9da9f1-2bef-426e-b75e-b49ee60f163a Apr 29 06:37:32 devstack sudo[86068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:32 devstack sudo[86068]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f4a7a5a2-a7bf-469a-9e49-a3db203b5dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea.cd9da9f1-2bef-426e-b75e-b49ee60f163a" returned: 0 in 0.760s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f4a7a5a2-a7bf-469a-9e49-a3db203b5dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:32 devstack sudo[86071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea.info Apr 29 06:37:32 devstack sudo[86071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:33 devstack sudo[86071]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f4a7a5a2-a7bf-469a-9e49-a3db203b5dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea.info" returned: 0 in 0.660s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:33 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-f4a7a5a2-a7bf-469a-9e49-a3db203b5dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea.info is being set with open permissions: ugo+rw Apr 29 06:37:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f4a7a5a2-a7bf-469a-9e49-a3db203b5dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:33 devstack sudo[86077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea.info Apr 29 06:37:33 devstack sudo[86077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:34 devstack sudo[86077]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f4a7a5a2-a7bf-469a-9e49-a3db203b5dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea.info" returned: 0 in 0.763s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f4a7a5a2-a7bf-469a-9e49-a3db203b5dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.984s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:37:34 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-f4a7a5a2-a7bf-469a-9e49-a3db203b5dbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Create snapshot completed successfully Apr 29 06:37:35 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-e7197978-d8be-4866-bcf5-78aa50d4350f tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Acquiring lock "cinder-cd9da9f1-2bef-426e-b75e-b49ee60f163a-delete_snapshot" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:37:35 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-e7197978-d8be-4866-bcf5-78aa50d4350f tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Lock "cinder-cd9da9f1-2bef-426e-b75e-b49ee60f163a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:37:35 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-e7197978-d8be-4866-bcf5-78aa50d4350f tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Acquiring lock "cinder-quobyte-b9fb565b-0372-4c35-8f11-29b75cca81ea" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:37:35 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-e7197978-d8be-4866-bcf5-78aa50d4350f tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Lock "cinder-quobyte-b9fb565b-0372-4c35-8f11-29b75cca81ea" acquired by "delete_snapshot" :: waited 0.026s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:37:35 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-e7197978-d8be-4866-bcf5-78aa50d4350f tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Acquiring lock "cinder-quobyte-cd9da9f1-2bef-426e-b75e-b49ee60f163a" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:37:35 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-e7197978-d8be-4866-bcf5-78aa50d4350f tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Lock "cinder-quobyte-cd9da9f1-2bef-426e-b75e-b49ee60f163a" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:37:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-e7197978-d8be-4866-bcf5-78aa50d4350f tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Deleting offline snapshot cd9da9f1-2bef-426e-b75e-b49ee60f163a of volume b9fb565b-0372-4c35-8f11-29b75cca81ea {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:37:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-e7197978-d8be-4866-bcf5-78aa50d4350f tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] snapshot_file for this snap is: volume-b9fb565b-0372-4c35-8f11-29b75cca81ea.cd9da9f1-2bef-426e-b75e-b49ee60f163a {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:37:35 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[d609afad-09ed-4fcc-9dcc-145a92e7cd3f]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:37:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e7197978-d8be-4866-bcf5-78aa50d4350f tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea.cd9da9f1-2bef-426e-b75e-b49ee60f163a {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:35 devstack sudo[86138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea.cd9da9f1-2bef-426e-b75e-b49ee60f163a Apr 29 06:37:35 devstack sudo[86138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:36 devstack sudo[86138]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e7197978-d8be-4866-bcf5-78aa50d4350f tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea.cd9da9f1-2bef-426e-b75e-b49ee60f163a" returned: 0 in 0.945s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-e7197978-d8be-4866-bcf5-78aa50d4350f tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9fb565b-0372-4c35-8f11-29b75cca81ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:37:36 devstack cinder-volume[84195]: DEBUG oslo_service.periodic_task [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84195) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 06:37:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:37:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:37:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:37:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:37:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:37:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:36 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[71835092-4f64-4918-86cd-0fbd6f715f7f]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:37:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e7197978-d8be-4866-bcf5-78aa50d4350f tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:36 devstack sudo[86155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:37:36 devstack sudo[86155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:36 devstack sudo[86156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea Apr 29 06:37:36 devstack sudo[86156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:37 devstack sudo[86155]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.699s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:37 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:37:37 devstack sudo[86156]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e7197978-d8be-4866-bcf5-78aa50d4350f tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea" returned: 0 in 0.805s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e7197978-d8be-4866-bcf5-78aa50d4350f tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea.cd9da9f1-2bef-426e-b75e-b49ee60f163a {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:37 devstack sudo[86163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea.cd9da9f1-2bef-426e-b75e-b49ee60f163a Apr 29 06:37:37 devstack sudo[86163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:38 devstack sudo[86163]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e7197978-d8be-4866-bcf5-78aa50d4350f tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea.cd9da9f1-2bef-426e-b75e-b49ee60f163a" returned: 0 in 0.910s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e7197978-d8be-4866-bcf5-78aa50d4350f tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea.cd9da9f1-2bef-426e-b75e-b49ee60f163a {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:38 devstack sudo[86172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea.cd9da9f1-2bef-426e-b75e-b49ee60f163a Apr 29 06:37:38 devstack sudo[86172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:39 devstack sudo[86172]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e7197978-d8be-4866-bcf5-78aa50d4350f tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea.cd9da9f1-2bef-426e-b75e-b49ee60f163a" returned: 0 in 1.010s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:39 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-e7197978-d8be-4866-bcf5-78aa50d4350f tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Lock "cinder-quobyte-cd9da9f1-2bef-426e-b75e-b49ee60f163a" released by "_delete_snapshot" :: held 3.889s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:37:39 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-e7197978-d8be-4866-bcf5-78aa50d4350f tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Lock "cinder-quobyte-b9fb565b-0372-4c35-8f11-29b75cca81ea" released by "delete_snapshot" :: held 3.942s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:37:39 devstack cinder-volume[84195]: WARNING cinder.quota [None req-e7197978-d8be-4866-bcf5-78aa50d4350f tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 06:37:39 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-e7197978-d8be-4866-bcf5-78aa50d4350f tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Created reservations ['cdc9ca6c-1a68-4a95-a147-33b04402f971', 'a9368862-b622-4393-9308-b69897cdc5c8', '07f51dd9-4ca3-43d0-a490-3870bcfde16b', 'b0228dd4-6ab0-43cf-ad84-44caaad2b975'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:37:39 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-e7197978-d8be-4866-bcf5-78aa50d4350f tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Delete snapshot completed successfully. Apr 29 06:37:39 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-e7197978-d8be-4866-bcf5-78aa50d4350f tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Lock "cinder-cd9da9f1-2bef-426e-b75e-b49ee60f163a-delete_snapshot" released by "delete_snapshot" :: held 4.338s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:37:40 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-00ff547e-777c-483d-81d7-80c6084705a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Acquiring lock "cinder-b9fb565b-0372-4c35-8f11-29b75cca81ea-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:37:40 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-00ff547e-777c-483d-81d7-80c6084705a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Lock "cinder-b9fb565b-0372-4c35-8f11-29b75cca81ea-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:37:40 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-00ff547e-777c-483d-81d7-80c6084705a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Acquiring lock "cinder-quobyte-b9fb565b-0372-4c35-8f11-29b75cca81ea" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:37:40 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-00ff547e-777c-483d-81d7-80c6084705a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Lock "cinder-quobyte-b9fb565b-0372-4c35-8f11-29b75cca81ea" acquired by "delete_volume" :: waited 0.022s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:37:40 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[50321e0e-4413-44df-8f66-ae6627525efc]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:37:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-00ff547e-777c-483d-81d7-80c6084705a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:40 devstack sudo[86179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea Apr 29 06:37:40 devstack sudo[86179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:41 devstack sudo[86179]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-00ff547e-777c-483d-81d7-80c6084705a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea" returned: 0 in 1.400s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-00ff547e-777c-483d-81d7-80c6084705a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:41 devstack sudo[86201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea Apr 29 06:37:41 devstack sudo[86201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:42 devstack sudo[86201]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-00ff547e-777c-483d-81d7-80c6084705a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b9fb565b-0372-4c35-8f11-29b75cca81ea" returned: 0 in 0.911s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:42 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-00ff547e-777c-483d-81d7-80c6084705a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Lock "cinder-quobyte-b9fb565b-0372-4c35-8f11-29b75cca81ea" released by "delete_volume" :: held 2.455s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:37:42 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-00ff547e-777c-483d-81d7-80c6084705a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Created reservations ['12557206-a2b1-42b0-ba36-b4fd786fd004', '7be9e3d0-6111-4da0-9b24-08440ba26149', 'b51cd0e0-03b6-4795-98a7-a1f6ada41812', '83521261-70e9-45bf-b765-8eeb4df1b527'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:37:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-00ff547e-777c-483d-81d7-80c6084705a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:37:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-00ff547e-777c-483d-81d7-80c6084705a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:37:42 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-00ff547e-777c-483d-81d7-80c6084705a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:37:42 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-00ff547e-777c-483d-81d7-80c6084705a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:37:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-00ff547e-777c-483d-81d7-80c6084705a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:37:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-00ff547e-777c-483d-81d7-80c6084705a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:42 devstack sudo[86206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:37:42 devstack sudo[86206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:43 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:37:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Flow 'volume_create_manager' (3c920de5-ab25-4aaf-88e6-9e147ddb4acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:37:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb84463-8330-4b92-b235-b0696c497802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:37:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb84463-8330-4b92-b235-b0696c497802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2002738417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ee4bf9a-151d-4d56-bfe1-ff84eb2ea7f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce98f02c053a49f88b144d3b4bc3075a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:37:43Z,use_quota=True,user_id='c7a292749b5c462c8f5d3b6820dffe32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:37:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9688a1e2-38ae-4684-ae01-2c1971ec8dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:37:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9688a1e2-38ae-4684-ae01-2c1971ec8dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:37:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfef9fd9-c4f0-4c3f-b9f8-e17b3b1734da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:37:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfef9fd9-c4f0-4c3f-b9f8-e17b3b1734da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ee4bf9a-151d-4d56-bfe1-ff84eb2ea7f3', 'volume_name': 'volume-1ee4bf9a-151d-4d56-bfe1-ff84eb2ea7f3', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:37:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18013ec0-d697-4ca1-a7bd-e532fcfe1e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:37:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18013ec0-d697-4ca1-a7bd-e532fcfe1e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:37:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9db1e4-629a-4589-be1b-161c9b4f241d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:37:43 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Volume 1ee4bf9a-151d-4d56-bfe1-ff84eb2ea7f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ee4bf9a-151d-4d56-bfe1-ff84eb2ea7f3', 'volume_size': 1} Apr 29 06:37:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:37:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:37:43 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2002738417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ee4bf9a-151d-4d56-bfe1-ff84eb2ea7f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce98f02c053a49f88b144d3b4bc3075a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:37:43Z,use_quota=True,user_id='c7a292749b5c462c8f5d3b6820dffe32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:37:43 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Creating volume 1ee4bf9a-151d-4d56-bfe1-ff84eb2ea7f3 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:37:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:37:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:37:43 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:37:43 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:37:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:37:43 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:37:43 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:37:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1ee4bf9a-151d-4d56-bfe1-ff84eb2ea7f3 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:43 devstack sudo[86208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1ee4bf9a-151d-4d56-bfe1-ff84eb2ea7f3 1073741824 Apr 29 06:37:43 devstack sudo[86208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:43 devstack sudo[86206]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-00ff547e-777c-483d-81d7-80c6084705a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 1.121s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:43 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-00ff547e-777c-483d-81d7-80c6084705a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:37:43 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-00ff547e-777c-483d-81d7-80c6084705a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Deleted volume successfully. Apr 29 06:37:44 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-00ff547e-777c-483d-81d7-80c6084705a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890083160 None] Lock "cinder-b9fb565b-0372-4c35-8f11-29b75cca81ea-delete_volume" released by "delete_volume" :: held 3.971s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:37:44 devstack sudo[86208]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1ee4bf9a-151d-4d56-bfe1-ff84eb2ea7f3 1073741824" returned: 0 in 1.362s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1ee4bf9a-151d-4d56-bfe1-ff84eb2ea7f3 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:44 devstack sudo[86215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1ee4bf9a-151d-4d56-bfe1-ff84eb2ea7f3 Apr 29 06:37:44 devstack sudo[86215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:45 devstack sudo[86215]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1ee4bf9a-151d-4d56-bfe1-ff84eb2ea7f3" returned: 0 in 1.173s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] <== create_volume: return (2607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:37:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.610s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:37:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9db1e4-629a-4589-be1b-161c9b4f241d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ee4bf9a-151d-4d56-bfe1-ff84eb2ea7f3', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:37:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d25062fd-17d2-48a3-b6fb-c95a00962c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:37:46 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Volume volume-1ee4bf9a-151d-4d56-bfe1-ff84eb2ea7f3 (1ee4bf9a-151d-4d56-bfe1-ff84eb2ea7f3): created successfully Apr 29 06:37:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d25062fd-17d2-48a3-b6fb-c95a00962c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:37:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Flow 'volume_create_manager' (3c920de5-ab25-4aaf-88e6-9e147ddb4acf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:37:46 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-9c3f9ac0-dbf3-4ab7-b635-68b268ab38cc tempest-VolumesAdminNegativeTest-429528801 None] Created volume successfully. Apr 29 06:37:46 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:37:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Flow 'volume_create_manager' (81741f0f-ae0d-4162-9b75-2ab1d8b61857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:37:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e2cbcd-40d6-4e75-8015-81ec51ae98ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:37:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e2cbcd-40d6-4e75-8015-81ec51ae98ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1980481336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37264309-f279-4c10-a7c7-a9e8eac5fa25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea9d448535d54ae2946be65c6768e12d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:37:47Z,use_quota=True,user_id='57c4e82e1f6345b884e708f9af5b3f80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:37:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcebbc5b-8460-4de1-b2fe-236530df70fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:37:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcebbc5b-8460-4de1-b2fe-236530df70fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:37:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497a4104-84ab-4e0d-8b1f-59972d8a3a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:37:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497a4104-84ab-4e0d-8b1f-59972d8a3a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37264309-f279-4c10-a7c7-a9e8eac5fa25', 'volume_name': 'volume-37264309-f279-4c10-a7c7-a9e8eac5fa25', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:37:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b94e6036-4eae-41ab-8a1a-f6a656324214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:37:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b94e6036-4eae-41ab-8a1a-f6a656324214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:37:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84328359-d612-4b29-a2ad-f805165ef5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:37:47 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Volume 37264309-f279-4c10-a7c7-a9e8eac5fa25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37264309-f279-4c10-a7c7-a9e8eac5fa25', 'volume_size': 1} Apr 29 06:37:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:37:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:37:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1980481336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37264309-f279-4c10-a7c7-a9e8eac5fa25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea9d448535d54ae2946be65c6768e12d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:37:47Z,use_quota=True,user_id='57c4e82e1f6345b884e708f9af5b3f80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:37:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Creating volume 37264309-f279-4c10-a7c7-a9e8eac5fa25 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:37:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:37:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:37:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:37:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:37:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:37:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:37:47 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:37:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-37264309-f279-4c10-a7c7-a9e8eac5fa25 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:47 devstack sudo[86220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-37264309-f279-4c10-a7c7-a9e8eac5fa25 1073741824 Apr 29 06:37:47 devstack sudo[86220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1eaba598-9624-4b6d-bcd2-74df1d46987e tempest-VolumesAdminNegativeTest-429528801 None] Acquiring lock "cinder-1ee4bf9a-151d-4d56-bfe1-ff84eb2ea7f3-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:37:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1eaba598-9624-4b6d-bcd2-74df1d46987e tempest-VolumesAdminNegativeTest-429528801 None] Lock "cinder-1ee4bf9a-151d-4d56-bfe1-ff84eb2ea7f3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:37:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1eaba598-9624-4b6d-bcd2-74df1d46987e tempest-VolumesAdminNegativeTest-429528801 None] Acquiring lock "cinder-quobyte-1ee4bf9a-151d-4d56-bfe1-ff84eb2ea7f3" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:37:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1eaba598-9624-4b6d-bcd2-74df1d46987e tempest-VolumesAdminNegativeTest-429528801 None] Lock "cinder-quobyte-1ee4bf9a-151d-4d56-bfe1-ff84eb2ea7f3" acquired by "delete_volume" :: waited 0.022s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:37:47 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[5863bc21-12ca-4e2e-a52d-f4159fcae84c]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:37:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1eaba598-9624-4b6d-bcd2-74df1d46987e tempest-VolumesAdminNegativeTest-429528801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1ee4bf9a-151d-4d56-bfe1-ff84eb2ea7f3 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:48 devstack sudo[86226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1ee4bf9a-151d-4d56-bfe1-ff84eb2ea7f3 Apr 29 06:37:48 devstack sudo[86226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:48 devstack sudo[86220]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-37264309-f279-4c10-a7c7-a9e8eac5fa25 1073741824" returned: 0 in 1.312s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-37264309-f279-4c10-a7c7-a9e8eac5fa25 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:48 devstack sudo[86232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-37264309-f279-4c10-a7c7-a9e8eac5fa25 Apr 29 06:37:48 devstack sudo[86232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:49 devstack sudo[86226]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1eaba598-9624-4b6d-bcd2-74df1d46987e tempest-VolumesAdminNegativeTest-429528801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1ee4bf9a-151d-4d56-bfe1-ff84eb2ea7f3" returned: 0 in 1.299s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1eaba598-9624-4b6d-bcd2-74df1d46987e tempest-VolumesAdminNegativeTest-429528801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1ee4bf9a-151d-4d56-bfe1-ff84eb2ea7f3 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:49 devstack sudo[86259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1ee4bf9a-151d-4d56-bfe1-ff84eb2ea7f3 Apr 29 06:37:49 devstack sudo[86259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:49 devstack sudo[86232]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-37264309-f279-4c10-a7c7-a9e8eac5fa25" returned: 0 in 1.542s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] <== create_volume: return (2937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:37:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.943s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:37:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84328359-d612-4b29-a2ad-f805165ef5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37264309-f279-4c10-a7c7-a9e8eac5fa25', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:37:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14765fc3-5e8d-4d37-98a9-d2fa47a22419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:37:50 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Volume volume-37264309-f279-4c10-a7c7-a9e8eac5fa25 (37264309-f279-4c10-a7c7-a9e8eac5fa25): created successfully Apr 29 06:37:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14765fc3-5e8d-4d37-98a9-d2fa47a22419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:37:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Flow 'volume_create_manager' (81741f0f-ae0d-4162-9b75-2ab1d8b61857) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:37:50 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-5d08d17b-cd7e-47c7-a47b-d26c4e4684dd tempest-VolumeQuotasNegativeTestJSON-210480718 None] Created volume successfully. Apr 29 06:37:50 devstack sudo[86259]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1eaba598-9624-4b6d-bcd2-74df1d46987e tempest-VolumesAdminNegativeTest-429528801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1ee4bf9a-151d-4d56-bfe1-ff84eb2ea7f3" returned: 0 in 1.567s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:50 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1eaba598-9624-4b6d-bcd2-74df1d46987e tempest-VolumesAdminNegativeTest-429528801 None] Lock "cinder-quobyte-1ee4bf9a-151d-4d56-bfe1-ff84eb2ea7f3" released by "delete_volume" :: held 2.945s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:37:50 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-1eaba598-9624-4b6d-bcd2-74df1d46987e tempest-VolumesAdminNegativeTest-429528801 None] Created reservations ['3432675c-46c0-4745-9c35-47885efcc7d6', '7b5b6fe5-9f02-4747-b05e-0e55aff96397', '727a2c3d-19b7-4e17-b21b-ffe5fb5ea311', '0659faf7-8bfc-4087-ad9e-1f0292779485'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:37:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1eaba598-9624-4b6d-bcd2-74df1d46987e tempest-VolumesAdminNegativeTest-429528801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:37:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1eaba598-9624-4b6d-bcd2-74df1d46987e tempest-VolumesAdminNegativeTest-429528801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:37:50 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1eaba598-9624-4b6d-bcd2-74df1d46987e tempest-VolumesAdminNegativeTest-429528801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:37:50 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1eaba598-9624-4b6d-bcd2-74df1d46987e tempest-VolumesAdminNegativeTest-429528801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:37:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1eaba598-9624-4b6d-bcd2-74df1d46987e tempest-VolumesAdminNegativeTest-429528801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:37:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1eaba598-9624-4b6d-bcd2-74df1d46987e tempest-VolumesAdminNegativeTest-429528801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:50 devstack sudo[86342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:37:50 devstack sudo[86342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:52 devstack sudo[86342]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1eaba598-9624-4b6d-bcd2-74df1d46987e tempest-VolumesAdminNegativeTest-429528801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 1.350s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:52 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-1eaba598-9624-4b6d-bcd2-74df1d46987e tempest-VolumesAdminNegativeTest-429528801 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:37:52 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-1eaba598-9624-4b6d-bcd2-74df1d46987e tempest-VolumesAdminNegativeTest-429528801 None] Deleted volume successfully. Apr 29 06:37:52 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1eaba598-9624-4b6d-bcd2-74df1d46987e tempest-VolumesAdminNegativeTest-429528801 None] Lock "cinder-1ee4bf9a-151d-4d56-bfe1-ff84eb2ea7f3-delete_volume" released by "delete_volume" :: held 4.745s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:37:52 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ce592fac-1fbd-42d5-a9be-d0fff3099b50 tempest-VolumeQuotasNegativeTestJSON-210480718 None] Acquiring lock "cinder-37264309-f279-4c10-a7c7-a9e8eac5fa25-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:37:52 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ce592fac-1fbd-42d5-a9be-d0fff3099b50 tempest-VolumeQuotasNegativeTestJSON-210480718 None] Lock "cinder-37264309-f279-4c10-a7c7-a9e8eac5fa25-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:37:52 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ce592fac-1fbd-42d5-a9be-d0fff3099b50 tempest-VolumeQuotasNegativeTestJSON-210480718 None] Acquiring lock "cinder-quobyte-37264309-f279-4c10-a7c7-a9e8eac5fa25" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:37:52 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ce592fac-1fbd-42d5-a9be-d0fff3099b50 tempest-VolumeQuotasNegativeTestJSON-210480718 None] Lock "cinder-quobyte-37264309-f279-4c10-a7c7-a9e8eac5fa25" acquired by "delete_volume" :: waited 0.036s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:37:52 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e6beb8-9441-4f1e-af1b-b12e445e64c1]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:37:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ce592fac-1fbd-42d5-a9be-d0fff3099b50 tempest-VolumeQuotasNegativeTestJSON-210480718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-37264309-f279-4c10-a7c7-a9e8eac5fa25 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:53 devstack sudo[86379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-37264309-f279-4c10-a7c7-a9e8eac5fa25 Apr 29 06:37:53 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:54 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ce592fac-1fbd-42d5-a9be-d0fff3099b50 tempest-VolumeQuotasNegativeTestJSON-210480718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-37264309-f279-4c10-a7c7-a9e8eac5fa25" returned: 0 in 1.279s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ce592fac-1fbd-42d5-a9be-d0fff3099b50 tempest-VolumeQuotasNegativeTestJSON-210480718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-37264309-f279-4c10-a7c7-a9e8eac5fa25 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:54 devstack sudo[86390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-37264309-f279-4c10-a7c7-a9e8eac5fa25 Apr 29 06:37:54 devstack sudo[86390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:55 devstack sudo[86390]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ce592fac-1fbd-42d5-a9be-d0fff3099b50 tempest-VolumeQuotasNegativeTestJSON-210480718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-37264309-f279-4c10-a7c7-a9e8eac5fa25" returned: 0 in 0.917s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ce592fac-1fbd-42d5-a9be-d0fff3099b50 tempest-VolumeQuotasNegativeTestJSON-210480718 None] Lock "cinder-quobyte-37264309-f279-4c10-a7c7-a9e8eac5fa25" released by "delete_volume" :: held 2.298s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:37:55 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-ce592fac-1fbd-42d5-a9be-d0fff3099b50 tempest-VolumeQuotasNegativeTestJSON-210480718 None] Created reservations ['bc8d50c7-e6b3-4fa3-9271-1fa9b771156d', '86025001-919f-4dfa-82bf-49fc775b8281', '89977ba8-98fe-46e2-a3fb-ee626be760df', 'd5b9f57e-29ab-45db-bba5-414258d5a3db'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:37:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-ce592fac-1fbd-42d5-a9be-d0fff3099b50 tempest-VolumeQuotasNegativeTestJSON-210480718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:37:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-ce592fac-1fbd-42d5-a9be-d0fff3099b50 tempest-VolumeQuotasNegativeTestJSON-210480718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:37:55 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-ce592fac-1fbd-42d5-a9be-d0fff3099b50 tempest-VolumeQuotasNegativeTestJSON-210480718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:37:55 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-ce592fac-1fbd-42d5-a9be-d0fff3099b50 tempest-VolumeQuotasNegativeTestJSON-210480718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:37:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-ce592fac-1fbd-42d5-a9be-d0fff3099b50 tempest-VolumeQuotasNegativeTestJSON-210480718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:37:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ce592fac-1fbd-42d5-a9be-d0fff3099b50 tempest-VolumeQuotasNegativeTestJSON-210480718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:37:55 devstack sudo[86394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:37:55 devstack sudo[86394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:37:56 devstack sudo[86394]: pam_unix(sudo:session): session closed for user root Apr 29 06:37:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ce592fac-1fbd-42d5-a9be-d0fff3099b50 tempest-VolumeQuotasNegativeTestJSON-210480718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.870s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:37:56 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-ce592fac-1fbd-42d5-a9be-d0fff3099b50 tempest-VolumeQuotasNegativeTestJSON-210480718 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:37:56 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-ce592fac-1fbd-42d5-a9be-d0fff3099b50 tempest-VolumeQuotasNegativeTestJSON-210480718 None] Deleted volume successfully. Apr 29 06:37:56 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ce592fac-1fbd-42d5-a9be-d0fff3099b50 tempest-VolumeQuotasNegativeTestJSON-210480718 None] Lock "cinder-37264309-f279-4c10-a7c7-a9e8eac5fa25-delete_volume" released by "delete_volume" :: held 3.510s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:38:05 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:SELECT=32,cinder:UPDATE=38,cinder:INSERT=12,cinder:DELETE=2 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:38:06 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:SELECT=42,cinder:UPDATE=50,cinder:DELETE=5,cinder:INSERT=9 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:38:06 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:38:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Flow 'volume_create_manager' (2bb7f80d-ba52-42e8-aebd-5df70bd54eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:38:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac03b719-6ae0-4f3d-9b10-c4d6561a96fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac03b719-6ae0-4f3d-9b10-c4d6561a96fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-81830645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c5f9541-e4a3-4938-a57a-6ea85c9fc06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40bca143dd5242e2955f5b48265bb627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:38:06Z,use_quota=True,user_id='40ecd711df8a406295563a7dcd42c417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77abe94c-6c9d-46a0-9f05-1849c84db5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77abe94c-6c9d-46a0-9f05-1849c84db5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e1fbbd-fb01-424f-8c92-33804dc54bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e1fbbd-fb01-424f-8c92-33804dc54bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c5f9541-e4a3-4938-a57a-6ea85c9fc06e', 'volume_name': 'volume-3c5f9541-e4a3-4938-a57a-6ea85c9fc06e', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da85b217-2ade-42ed-bb6a-dd0de9f4bfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da85b217-2ade-42ed-bb6a-dd0de9f4bfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62271f23-d0dd-472f-9f58-e82088280c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:06 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Volume 3c5f9541-e4a3-4938-a57a-6ea85c9fc06e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c5f9541-e4a3-4938-a57a-6ea85c9fc06e', 'volume_size': 1} Apr 29 06:38:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:38:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:38:06 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-81830645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c5f9541-e4a3-4938-a57a-6ea85c9fc06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40bca143dd5242e2955f5b48265bb627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:38:06Z,use_quota=True,user_id='40ecd711df8a406295563a7dcd42c417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:38:06 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Creating volume 3c5f9541-e4a3-4938-a57a-6ea85c9fc06e {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:38:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:38:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:38:06 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:38:06 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:38:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:38:06 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:38:06 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:38:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3c5f9541-e4a3-4938-a57a-6ea85c9fc06e 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:06 devstack sudo[86450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3c5f9541-e4a3-4938-a57a-6ea85c9fc06e 1073741824 Apr 29 06:38:06 devstack sudo[86450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:07 devstack sudo[86450]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3c5f9541-e4a3-4938-a57a-6ea85c9fc06e 1073741824" returned: 0 in 0.979s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3c5f9541-e4a3-4938-a57a-6ea85c9fc06e {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:07 devstack sudo[86456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3c5f9541-e4a3-4938-a57a-6ea85c9fc06e Apr 29 06:38:07 devstack sudo[86456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:07 devstack sudo[86456]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3c5f9541-e4a3-4938-a57a-6ea85c9fc06e" returned: 0 in 0.645s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:38:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:38:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62271f23-d0dd-472f-9f58-e82088280c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c5f9541-e4a3-4938-a57a-6ea85c9fc06e', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f882a7-8d7c-4d79-8f4f-efca768abc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:08 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Volume volume-3c5f9541-e4a3-4938-a57a-6ea85c9fc06e (3c5f9541-e4a3-4938-a57a-6ea85c9fc06e): created successfully Apr 29 06:38:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f882a7-8d7c-4d79-8f4f-efca768abc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Flow 'volume_create_manager' (2bb7f80d-ba52-42e8-aebd-5df70bd54eb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:38:08 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-575278dd-2efd-42d6-8664-439600f40d43 tempest-VolumesServicesTestJSON-198933244 None] Created volume successfully. Apr 29 06:38:08 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-08d7ea58-7a27-4208-b9b1-bc2fe5eabfc5 tempest-VolumesServicesTestJSON-198933244 None] Acquiring lock "cinder-3c5f9541-e4a3-4938-a57a-6ea85c9fc06e-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:38:08 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-08d7ea58-7a27-4208-b9b1-bc2fe5eabfc5 tempest-VolumesServicesTestJSON-198933244 None] Lock "cinder-3c5f9541-e4a3-4938-a57a-6ea85c9fc06e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:38:08 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-08d7ea58-7a27-4208-b9b1-bc2fe5eabfc5 tempest-VolumesServicesTestJSON-198933244 None] Acquiring lock "cinder-quobyte-3c5f9541-e4a3-4938-a57a-6ea85c9fc06e" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:38:08 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-08d7ea58-7a27-4208-b9b1-bc2fe5eabfc5 tempest-VolumesServicesTestJSON-198933244 None] Lock "cinder-quobyte-3c5f9541-e4a3-4938-a57a-6ea85c9fc06e" acquired by "delete_volume" :: waited 0.019s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:38:08 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bcb5ff-5ac6-4081-9c2e-9935cc2e931c]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:38:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-08d7ea58-7a27-4208-b9b1-bc2fe5eabfc5 tempest-VolumesServicesTestJSON-198933244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3c5f9541-e4a3-4938-a57a-6ea85c9fc06e {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:08 devstack sudo[86461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3c5f9541-e4a3-4938-a57a-6ea85c9fc06e Apr 29 06:38:08 devstack sudo[86461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:09 devstack sudo[86461]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-08d7ea58-7a27-4208-b9b1-bc2fe5eabfc5 tempest-VolumesServicesTestJSON-198933244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3c5f9541-e4a3-4938-a57a-6ea85c9fc06e" returned: 0 in 0.877s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-08d7ea58-7a27-4208-b9b1-bc2fe5eabfc5 tempest-VolumesServicesTestJSON-198933244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3c5f9541-e4a3-4938-a57a-6ea85c9fc06e {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:09 devstack sudo[86466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3c5f9541-e4a3-4938-a57a-6ea85c9fc06e Apr 29 06:38:09 devstack sudo[86466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:10 devstack sudo[86466]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-08d7ea58-7a27-4208-b9b1-bc2fe5eabfc5 tempest-VolumesServicesTestJSON-198933244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3c5f9541-e4a3-4938-a57a-6ea85c9fc06e" returned: 0 in 0.665s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:10 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-08d7ea58-7a27-4208-b9b1-bc2fe5eabfc5 tempest-VolumesServicesTestJSON-198933244 None] Lock "cinder-quobyte-3c5f9541-e4a3-4938-a57a-6ea85c9fc06e" released by "delete_volume" :: held 1.591s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:38:10 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-08d7ea58-7a27-4208-b9b1-bc2fe5eabfc5 tempest-VolumesServicesTestJSON-198933244 None] Created reservations ['82537c9e-9a47-44b0-97c2-47e9a5f58613', 'a2527d7d-abcd-450f-a082-71b82d37a283', '1b26e741-2781-4e0c-bd85-0d50317a436d', 'd13282b4-d951-4f7c-ba4d-c654d396a432'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:38:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-08d7ea58-7a27-4208-b9b1-bc2fe5eabfc5 tempest-VolumesServicesTestJSON-198933244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:38:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-08d7ea58-7a27-4208-b9b1-bc2fe5eabfc5 tempest-VolumesServicesTestJSON-198933244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:38:10 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-08d7ea58-7a27-4208-b9b1-bc2fe5eabfc5 tempest-VolumesServicesTestJSON-198933244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:38:10 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-08d7ea58-7a27-4208-b9b1-bc2fe5eabfc5 tempest-VolumesServicesTestJSON-198933244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:38:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-08d7ea58-7a27-4208-b9b1-bc2fe5eabfc5 tempest-VolumesServicesTestJSON-198933244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:38:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-08d7ea58-7a27-4208-b9b1-bc2fe5eabfc5 tempest-VolumesServicesTestJSON-198933244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:10 devstack sudo[86469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:38:10 devstack sudo[86469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:11 devstack sudo[86469]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-08d7ea58-7a27-4208-b9b1-bc2fe5eabfc5 tempest-VolumesServicesTestJSON-198933244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.844s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:11 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-08d7ea58-7a27-4208-b9b1-bc2fe5eabfc5 tempest-VolumesServicesTestJSON-198933244 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:38:11 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-08d7ea58-7a27-4208-b9b1-bc2fe5eabfc5 tempest-VolumesServicesTestJSON-198933244 None] Deleted volume successfully. Apr 29 06:38:11 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-08d7ea58-7a27-4208-b9b1-bc2fe5eabfc5 tempest-VolumesServicesTestJSON-198933244 None] Lock "cinder-3c5f9541-e4a3-4938-a57a-6ea85c9fc06e-delete_volume" released by "delete_volume" :: held 2.733s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:38:18 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:38:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Flow 'volume_create_manager' (61a05631-c842-48de-a894-e3ec7adaf1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:38:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65236d21-e6ea-4799-b1be-f45113351e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65236d21-e6ea-4799-b1be-f45113351e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-515193298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=166291d9-aa37-4624-8df9-0793e1fdaf74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b4f06f760647e4bd7b1129ff6ade2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:38:18Z,use_quota=True,user_id='9d43317786084ee1ab63fcc274cf5d54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a5b093-385d-4323-adc8-e35bde2d06bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a5b093-385d-4323-adc8-e35bde2d06bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72757056-a66b-48b6-9a4a-7390de017fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72757056-a66b-48b6-9a4a-7390de017fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '166291d9-aa37-4624-8df9-0793e1fdaf74', 'volume_name': 'volume-166291d9-aa37-4624-8df9-0793e1fdaf74', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72146695-6ce0-4c53-a18e-ad1ee887b57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72146695-6ce0-4c53-a18e-ad1ee887b57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73444676-3db4-494d-be73-119555d6c5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:18 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Volume 166291d9-aa37-4624-8df9-0793e1fdaf74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-166291d9-aa37-4624-8df9-0793e1fdaf74', 'volume_size': 1} Apr 29 06:38:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:38:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:38:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-515193298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=166291d9-aa37-4624-8df9-0793e1fdaf74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b4f06f760647e4bd7b1129ff6ade2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:38:18Z,use_quota=True,user_id='9d43317786084ee1ab63fcc274cf5d54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:38:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Creating volume 166291d9-aa37-4624-8df9-0793e1fdaf74 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:38:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:38:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:38:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:38:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:38:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:38:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:38:18 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:38:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:18 devstack sudo[86488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74 1073741824 Apr 29 06:38:18 devstack sudo[86488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:19 devstack sudo[86488]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74 1073741824" returned: 0 in 1.291s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:19 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:38:19 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Flow 'volume_create_manager' (cbd2b09f-18ae-4458-bc0e-dda339ed08e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:38:19 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee9d12a3-bf7b-4268-b007-22578fe1a0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:19 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee9d12a3-bf7b-4268-b007-22578fe1a0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:38:19Z,deleted=False,deleted_at=None,display_description='',display_name='3cb0949f-4d58-48f8-b1a3-ada364ec4d06-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9003718-43b6-4c4f-9d1c-8ef609d9d8a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9754cd3eaea84f7bbf4fb98f6e306b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:38:19Z,use_quota=True,user_id='f7e85e53c25343b688bcd0c191bf4ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:19 devstack sudo[86531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74 Apr 29 06:38:19 devstack sudo[86531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:19 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a39c14d9-b3ce-4643-a81f-a50f1e3ee65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:19 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a39c14d9-b3ce-4643-a81f-a50f1e3ee65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:19 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95bb1fe3-1c32-4d5f-8f11-c0f95d0e9fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:19 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95bb1fe3-1c32-4d5f-8f11-c0f95d0e9fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9003718-43b6-4c4f-9d1c-8ef609d9d8a3', 'volume_name': 'volume-e9003718-43b6-4c4f-9d1c-8ef609d9d8a3', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:19 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d967f5ec-4c42-44ec-98ba-f4876b858ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:19 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d967f5ec-4c42-44ec-98ba-f4876b858ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:19 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c951b26-849c-4df2-a3eb-7a1fd971a365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:19 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Volume e9003718-43b6-4c4f-9d1c-8ef609d9d8a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9003718-43b6-4c4f-9d1c-8ef609d9d8a3', 'volume_size': 1} Apr 29 06:38:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:38:20 devstack sudo[86531]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74" returned: 0 in 0.725s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] <== create_volume: return (2093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:38:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.096s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:38:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.656s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:38:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:38:19Z,deleted=False,deleted_at=None,display_description='',display_name='3cb0949f-4d58-48f8-b1a3-ada364ec4d06-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9003718-43b6-4c4f-9d1c-8ef609d9d8a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9754cd3eaea84f7bbf4fb98f6e306b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:38:19Z,use_quota=True,user_id='f7e85e53c25343b688bcd0c191bf4ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:38:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Creating volume e9003718-43b6-4c4f-9d1c-8ef609d9d8a3 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:38:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:38:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:38:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:38:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:38:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:38:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:38:20 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:38:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e9003718-43b6-4c4f-9d1c-8ef609d9d8a3 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73444676-3db4-494d-be73-119555d6c5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-166291d9-aa37-4624-8df9-0793e1fdaf74', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b822859-a2b2-4288-b969-96d747b5cbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:20 devstack sudo[86534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e9003718-43b6-4c4f-9d1c-8ef609d9d8a3 1073741824 Apr 29 06:38:20 devstack sudo[86534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:20 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Volume volume-166291d9-aa37-4624-8df9-0793e1fdaf74 (166291d9-aa37-4624-8df9-0793e1fdaf74): created successfully Apr 29 06:38:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b822859-a2b2-4288-b969-96d747b5cbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Flow 'volume_create_manager' (61a05631-c842-48de-a894-e3ec7adaf1c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:38:20 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-41b75403-e1e5-4c1a-8009-c3feb9ad63b6 tempest-SnapshotMetadataTestJSON-283065091 None] Created volume successfully. Apr 29 06:38:21 devstack sudo[86534]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e9003718-43b6-4c4f-9d1c-8ef609d9d8a3 1073741824" returned: 0 in 1.011s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e9003718-43b6-4c4f-9d1c-8ef609d9d8a3 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:21 devstack sudo[86541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e9003718-43b6-4c4f-9d1c-8ef609d9d8a3 Apr 29 06:38:21 devstack sudo[86541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-340722f9-21e0-4d6c-b3ad-a4ea51a750f6 tempest-SnapshotMetadataTestJSON-283065091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:38:22 devstack sudo[86541]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e9003718-43b6-4c4f-9d1c-8ef609d9d8a3" returned: 0 in 0.943s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] <== create_volume: return (2047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:38:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.050s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:38:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-340722f9-21e0-4d6c-b3ad-a4ea51a750f6 tempest-SnapshotMetadataTestJSON-283065091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.564s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:38:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-340722f9-21e0-4d6c-b3ad-a4ea51a750f6 tempest-SnapshotMetadataTestJSON-283065091 None] Creating offline snapshot 9b241085-bd1b-464c-82ac-4772c1e53c31 of volume 166291d9-aa37-4624-8df9-0793e1fdaf74 {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:38:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c951b26-849c-4df2-a3eb-7a1fd971a365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9003718-43b6-4c4f-9d1c-8ef609d9d8a3', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b545a3c-4431-4c80-8ec9-b39d57c890f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:22 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ec3f3e-4100-4f70-978a-91fbdc1cd180]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:38:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-340722f9-21e0-4d6c-b3ad-a4ea51a750f6 tempest-SnapshotMetadataTestJSON-283065091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:22 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Volume volume-e9003718-43b6-4c4f-9d1c-8ef609d9d8a3 (e9003718-43b6-4c4f-9d1c-8ef609d9d8a3): created successfully Apr 29 06:38:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b545a3c-4431-4c80-8ec9-b39d57c890f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Flow 'volume_create_manager' (cbd2b09f-18ae-4458-bc0e-dda339ed08e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:38:22 devstack cinder-volume[84195]: INFO cinder.volume.manager [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-25a172b0-b51b-4d83-ba11-d04ef94cde56 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Created volume successfully. Apr 29 06:38:22 devstack sudo[86546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74 Apr 29 06:38:22 devstack sudo[86546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-ce0f03af-dfec-4789-bfed-f0b39aa25ec6 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:38:23 devstack sudo[86546]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-340722f9-21e0-4d6c-b3ad-a4ea51a750f6 tempest-SnapshotMetadataTestJSON-283065091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74" returned: 0 in 1.181s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-340722f9-21e0-4d6c-b3ad-a4ea51a750f6 tempest-SnapshotMetadataTestJSON-283065091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74.9b241085-bd1b-464c-82ac-4772c1e53c31 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:23 devstack sudo[86559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74.9b241085-bd1b-464c-82ac-4772c1e53c31 1G Apr 29 06:38:23 devstack sudo[86559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:24 devstack sudo[86559]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-340722f9-21e0-4d6c-b3ad-a4ea51a750f6 tempest-SnapshotMetadataTestJSON-283065091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74.9b241085-bd1b-464c-82ac-4772c1e53c31 1G" returned: 0 in 0.950s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-340722f9-21e0-4d6c-b3ad-a4ea51a750f6 tempest-SnapshotMetadataTestJSON-283065091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-166291d9-aa37-4624-8df9-0793e1fdaf74 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74.9b241085-bd1b-464c-82ac-4772c1e53c31 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:24 devstack sudo[86566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-166291d9-aa37-4624-8df9-0793e1fdaf74 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74.9b241085-bd1b-464c-82ac-4772c1e53c31 Apr 29 06:38:24 devstack sudo[86566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:25 devstack sudo[86566]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-340722f9-21e0-4d6c-b3ad-a4ea51a750f6 tempest-SnapshotMetadataTestJSON-283065091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-166291d9-aa37-4624-8df9-0793e1fdaf74 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74.9b241085-bd1b-464c-82ac-4772c1e53c31" returned: 0 in 0.858s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:25 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-340722f9-21e0-4d6c-b3ad-a4ea51a750f6 tempest-SnapshotMetadataTestJSON-283065091 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74.9b241085-bd1b-464c-82ac-4772c1e53c31 is being set with open permissions: ugo+rw Apr 29 06:38:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-340722f9-21e0-4d6c-b3ad-a4ea51a750f6 tempest-SnapshotMetadataTestJSON-283065091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74.9b241085-bd1b-464c-82ac-4772c1e53c31 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:25 devstack sudo[86572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74.9b241085-bd1b-464c-82ac-4772c1e53c31 Apr 29 06:38:25 devstack sudo[86572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:26 devstack sudo[86572]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-340722f9-21e0-4d6c-b3ad-a4ea51a750f6 tempest-SnapshotMetadataTestJSON-283065091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74.9b241085-bd1b-464c-82ac-4772c1e53c31" returned: 0 in 0.695s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-340722f9-21e0-4d6c-b3ad-a4ea51a750f6 tempest-SnapshotMetadataTestJSON-283065091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:26 devstack sudo[86576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74.info Apr 29 06:38:26 devstack sudo[86576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:27 devstack sudo[86576]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-340722f9-21e0-4d6c-b3ad-a4ea51a750f6 tempest-SnapshotMetadataTestJSON-283065091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74.info" returned: 0 in 0.866s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:27 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-340722f9-21e0-4d6c-b3ad-a4ea51a750f6 tempest-SnapshotMetadataTestJSON-283065091 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74.info is being set with open permissions: ugo+rw Apr 29 06:38:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-340722f9-21e0-4d6c-b3ad-a4ea51a750f6 tempest-SnapshotMetadataTestJSON-283065091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:27 devstack sudo[86579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74.info Apr 29 06:38:27 devstack sudo[86579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:27 devstack sudo[86579]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-340722f9-21e0-4d6c-b3ad-a4ea51a750f6 tempest-SnapshotMetadataTestJSON-283065091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74.info" returned: 0 in 0.730s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-340722f9-21e0-4d6c-b3ad-a4ea51a750f6 tempest-SnapshotMetadataTestJSON-283065091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.403s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:38:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-ce0f03af-dfec-4789-bfed-f0b39aa25ec6 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.675s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:38:27 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde8c08b-c7db-40c5-bc68-20d6e01610ad]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:38:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-ce0f03af-dfec-4789-bfed-f0b39aa25ec6 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e9003718-43b6-4c4f-9d1c-8ef609d9d8a3 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:27 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-340722f9-21e0-4d6c-b3ad-a4ea51a750f6 tempest-SnapshotMetadataTestJSON-283065091 None] Create snapshot completed successfully Apr 29 06:38:27 devstack sudo[86585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e9003718-43b6-4c4f-9d1c-8ef609d9d8a3 Apr 29 06:38:27 devstack sudo[86585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:28 devstack sudo[86585]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-ce0f03af-dfec-4789-bfed-f0b39aa25ec6 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e9003718-43b6-4c4f-9d1c-8ef609d9d8a3" returned: 0 in 0.933s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-ce0f03af-dfec-4789-bfed-f0b39aa25ec6 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.969s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:38:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-ce0f03af-dfec-4789-bfed-f0b39aa25ec6 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9', 'name': 'volume-e9003718-43b6-4c4f-9d1c-8ef609d9d8a3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3bc2fc20-1b25-4b5b-bbc0-fd177fa4b0a8', 'enforce_multipath': True} {{(pid=84195) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 06:38:28 devstack cinder-volume[84195]: INFO cinder.volume.manager [req-c28c7246-b89a-470f-9608-a6c51b51a239 req-ce0f03af-dfec-4789-bfed-f0b39aa25ec6 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] attachment_update completed successfully. Apr 29 06:38:28 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-6074c38b-aac3-417b-b23d-2539483ec03b tempest-SnapshotMetadataTestJSON-283065091 None] Acquiring lock "cinder-9b241085-bd1b-464c-82ac-4772c1e53c31-delete_snapshot" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:38:29 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-6074c38b-aac3-417b-b23d-2539483ec03b tempest-SnapshotMetadataTestJSON-283065091 None] Lock "cinder-9b241085-bd1b-464c-82ac-4772c1e53c31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:38:29 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-6074c38b-aac3-417b-b23d-2539483ec03b tempest-SnapshotMetadataTestJSON-283065091 None] Acquiring lock "cinder-quobyte-166291d9-aa37-4624-8df9-0793e1fdaf74" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:38:29 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-6074c38b-aac3-417b-b23d-2539483ec03b tempest-SnapshotMetadataTestJSON-283065091 None] Lock "cinder-quobyte-166291d9-aa37-4624-8df9-0793e1fdaf74" acquired by "delete_snapshot" :: waited 0.036s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:38:29 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-6074c38b-aac3-417b-b23d-2539483ec03b tempest-SnapshotMetadataTestJSON-283065091 None] Acquiring lock "cinder-quobyte-9b241085-bd1b-464c-82ac-4772c1e53c31" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:38:29 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-6074c38b-aac3-417b-b23d-2539483ec03b tempest-SnapshotMetadataTestJSON-283065091 None] Lock "cinder-quobyte-9b241085-bd1b-464c-82ac-4772c1e53c31" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:38:29 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-6074c38b-aac3-417b-b23d-2539483ec03b tempest-SnapshotMetadataTestJSON-283065091 None] Deleting offline snapshot 9b241085-bd1b-464c-82ac-4772c1e53c31 of volume 166291d9-aa37-4624-8df9-0793e1fdaf74 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:38:29 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-6074c38b-aac3-417b-b23d-2539483ec03b tempest-SnapshotMetadataTestJSON-283065091 None] snapshot_file for this snap is: volume-166291d9-aa37-4624-8df9-0793e1fdaf74.9b241085-bd1b-464c-82ac-4772c1e53c31 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:38:29 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7597847-045d-4be2-a9b3-98f94ad46386]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:38:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-6074c38b-aac3-417b-b23d-2539483ec03b tempest-SnapshotMetadataTestJSON-283065091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74.9b241085-bd1b-464c-82ac-4772c1e53c31 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:29 devstack sudo[86593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74.9b241085-bd1b-464c-82ac-4772c1e53c31 Apr 29 06:38:29 devstack sudo[86593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:29 devstack sudo[86593]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-6074c38b-aac3-417b-b23d-2539483ec03b tempest-SnapshotMetadataTestJSON-283065091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74.9b241085-bd1b-464c-82ac-4772c1e53c31" returned: 0 in 0.785s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:29 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-6074c38b-aac3-417b-b23d-2539483ec03b tempest-SnapshotMetadataTestJSON-283065091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-166291d9-aa37-4624-8df9-0793e1fdaf74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:38:29 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71bda8d-c85f-4ff8-993a-f5b7520023b8]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:38:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-6074c38b-aac3-417b-b23d-2539483ec03b tempest-SnapshotMetadataTestJSON-283065091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:30 devstack sudo[86598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74 Apr 29 06:38:30 devstack sudo[86598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:30 devstack sudo[86598]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-6074c38b-aac3-417b-b23d-2539483ec03b tempest-SnapshotMetadataTestJSON-283065091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74" returned: 0 in 0.908s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-6074c38b-aac3-417b-b23d-2539483ec03b tempest-SnapshotMetadataTestJSON-283065091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74.9b241085-bd1b-464c-82ac-4772c1e53c31 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:30 devstack sudo[86605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74.9b241085-bd1b-464c-82ac-4772c1e53c31 Apr 29 06:38:30 devstack sudo[86605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:31 devstack sudo[86605]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-6074c38b-aac3-417b-b23d-2539483ec03b tempest-SnapshotMetadataTestJSON-283065091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74.9b241085-bd1b-464c-82ac-4772c1e53c31" returned: 0 in 0.801s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-6074c38b-aac3-417b-b23d-2539483ec03b tempest-SnapshotMetadataTestJSON-283065091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74.9b241085-bd1b-464c-82ac-4772c1e53c31 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:31 devstack sudo[86683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74.9b241085-bd1b-464c-82ac-4772c1e53c31 Apr 29 06:38:31 devstack sudo[86683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:32 devstack sudo[86683]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-6074c38b-aac3-417b-b23d-2539483ec03b tempest-SnapshotMetadataTestJSON-283065091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74.9b241085-bd1b-464c-82ac-4772c1e53c31" returned: 0 in 0.844s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:32 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-6074c38b-aac3-417b-b23d-2539483ec03b tempest-SnapshotMetadataTestJSON-283065091 None] Lock "cinder-quobyte-9b241085-bd1b-464c-82ac-4772c1e53c31" released by "_delete_snapshot" :: held 3.497s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:38:32 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-6074c38b-aac3-417b-b23d-2539483ec03b tempest-SnapshotMetadataTestJSON-283065091 None] Lock "cinder-quobyte-166291d9-aa37-4624-8df9-0793e1fdaf74" released by "delete_snapshot" :: held 3.531s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:38:32 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-6074c38b-aac3-417b-b23d-2539483ec03b tempest-SnapshotMetadataTestJSON-283065091 None] Created reservations ['576e73fc-954d-4d1f-986d-654544030cb5', '36e58098-9141-4564-8eb4-488ad751ca29', '79f456f7-9d5e-49f4-b50a-5a5b672a9c4d', 'b00f7b6b-be54-425d-963c-c6a2b5f6429f'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:38:32 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-6074c38b-aac3-417b-b23d-2539483ec03b tempest-SnapshotMetadataTestJSON-283065091 None] Delete snapshot completed successfully. Apr 29 06:38:32 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-6074c38b-aac3-417b-b23d-2539483ec03b tempest-SnapshotMetadataTestJSON-283065091 None] Lock "cinder-9b241085-bd1b-464c-82ac-4772c1e53c31-delete_snapshot" released by "delete_snapshot" :: held 3.720s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:38:33 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-a6b7d895-5064-4eea-8c8b-a6aaf17d9316 tempest-SnapshotMetadataTestJSON-283065091 None] Acquiring lock "cinder-166291d9-aa37-4624-8df9-0793e1fdaf74-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:38:33 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-a6b7d895-5064-4eea-8c8b-a6aaf17d9316 tempest-SnapshotMetadataTestJSON-283065091 None] Lock "cinder-166291d9-aa37-4624-8df9-0793e1fdaf74-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:38:33 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-a6b7d895-5064-4eea-8c8b-a6aaf17d9316 tempest-SnapshotMetadataTestJSON-283065091 None] Acquiring lock "cinder-quobyte-166291d9-aa37-4624-8df9-0793e1fdaf74" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:38:33 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-a6b7d895-5064-4eea-8c8b-a6aaf17d9316 tempest-SnapshotMetadataTestJSON-283065091 None] Lock "cinder-quobyte-166291d9-aa37-4624-8df9-0793e1fdaf74" acquired by "delete_volume" :: waited 0.025s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:38:33 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[5610a75d-b52e-4dbd-911e-fd4ae77035a3]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:38:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a6b7d895-5064-4eea-8c8b-a6aaf17d9316 tempest-SnapshotMetadataTestJSON-283065091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:33 devstack sudo[86690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74 Apr 29 06:38:33 devstack sudo[86690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:34 devstack sudo[86690]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a6b7d895-5064-4eea-8c8b-a6aaf17d9316 tempest-SnapshotMetadataTestJSON-283065091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74" returned: 0 in 1.303s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a6b7d895-5064-4eea-8c8b-a6aaf17d9316 tempest-SnapshotMetadataTestJSON-283065091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:34 devstack sudo[87045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74 Apr 29 06:38:34 devstack sudo[87045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:35 devstack sudo[87045]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a6b7d895-5064-4eea-8c8b-a6aaf17d9316 tempest-SnapshotMetadataTestJSON-283065091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-166291d9-aa37-4624-8df9-0793e1fdaf74" returned: 0 in 0.938s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:35 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-a6b7d895-5064-4eea-8c8b-a6aaf17d9316 tempest-SnapshotMetadataTestJSON-283065091 None] Lock "cinder-quobyte-166291d9-aa37-4624-8df9-0793e1fdaf74" released by "delete_volume" :: held 2.342s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:38:35 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-a6b7d895-5064-4eea-8c8b-a6aaf17d9316 tempest-SnapshotMetadataTestJSON-283065091 None] Created reservations ['ef59064b-5643-4407-932e-a55880cd0ac5', 'f18c1f83-8f0c-47b4-9981-db3e2ae95051', '413137fc-b14f-4836-8803-1d8ed5b61937', 'affb48b9-617d-4396-9ad6-9c3441b048fb'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:38:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a6b7d895-5064-4eea-8c8b-a6aaf17d9316 tempest-SnapshotMetadataTestJSON-283065091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:38:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a6b7d895-5064-4eea-8c8b-a6aaf17d9316 tempest-SnapshotMetadataTestJSON-283065091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:38:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-a6b7d895-5064-4eea-8c8b-a6aaf17d9316 tempest-SnapshotMetadataTestJSON-283065091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:38:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-a6b7d895-5064-4eea-8c8b-a6aaf17d9316 tempest-SnapshotMetadataTestJSON-283065091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:38:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a6b7d895-5064-4eea-8c8b-a6aaf17d9316 tempest-SnapshotMetadataTestJSON-283065091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:38:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a6b7d895-5064-4eea-8c8b-a6aaf17d9316 tempest-SnapshotMetadataTestJSON-283065091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:35 devstack sudo[87059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:38:35 devstack sudo[87059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:36 devstack cinder-volume[84195]: DEBUG oslo_service.periodic_task [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84195) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 06:38:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:38:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:38:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:38:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:38:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:38:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:36 devstack sudo[87070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:38:36 devstack sudo[87070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:36 devstack sudo[87059]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a6b7d895-5064-4eea-8c8b-a6aaf17d9316 tempest-SnapshotMetadataTestJSON-283065091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.744s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:36 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-a6b7d895-5064-4eea-8c8b-a6aaf17d9316 tempest-SnapshotMetadataTestJSON-283065091 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:38:36 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-a6b7d895-5064-4eea-8c8b-a6aaf17d9316 tempest-SnapshotMetadataTestJSON-283065091 None] Deleted volume successfully. Apr 29 06:38:36 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-a6b7d895-5064-4eea-8c8b-a6aaf17d9316 tempest-SnapshotMetadataTestJSON-283065091 None] Lock "cinder-166291d9-aa37-4624-8df9-0793e1fdaf74-delete_volume" released by "delete_volume" :: held 3.345s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:38:37 devstack sudo[87070]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.967s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:37 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:38:40 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:38:40 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Flow 'volume_create_manager' (51f339f0-dc0e-4354-99df-038ca24eb522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:38:40 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a0dab3-6df8-4708-8b9d-aa47e5e5241e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a0dab3-6df8-4708-8b9d-aa47e5e5241e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1552427139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=664f01f9-7a92-4f9a-a291-394d6f7d75ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35b89ae6589a4387bfb065d0bb3f45c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:38:41Z,use_quota=True,user_id='9b308e89f10942f98c61536157d39df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faafdb1a-9737-45f7-8057-5ac70632b07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faafdb1a-9737-45f7-8057-5ac70632b07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb7f4d0e-d3bd-4b53-87a5-cf49faadf605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb7f4d0e-d3bd-4b53-87a5-cf49faadf605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '664f01f9-7a92-4f9a-a291-394d6f7d75ba', 'volume_name': 'volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22f15bf-6c42-45a2-8c04-ace8ccbd3a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22f15bf-6c42-45a2-8c04-ace8ccbd3a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07a0264-a6e5-44da-a417-f36d4d314803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:41 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Volume 664f01f9-7a92-4f9a-a291-394d6f7d75ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba', 'volume_size': 1} Apr 29 06:38:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:38:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:38:41 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1552427139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=664f01f9-7a92-4f9a-a291-394d6f7d75ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35b89ae6589a4387bfb065d0bb3f45c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:38:41Z,use_quota=True,user_id='9b308e89f10942f98c61536157d39df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:38:41 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Creating volume 664f01f9-7a92-4f9a-a291-394d6f7d75ba {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:38:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:38:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:38:41 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:38:41 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:38:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:38:41 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:38:41 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:38:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:41 devstack sudo[87079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba 1073741824 Apr 29 06:38:41 devstack sudo[87079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:42 devstack sudo[87079]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba 1073741824" returned: 0 in 1.050s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:42 devstack sudo[87093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba Apr 29 06:38:42 devstack sudo[87093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:43 devstack sudo[87093]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba" returned: 0 in 1.092s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:43 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] <== create_volume: return (2215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:38:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.219s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:38:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07a0264-a6e5-44da-a417-f36d4d314803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88508bdc-e2ce-4a35-89d1-b96023fd8fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:43 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Volume volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba (664f01f9-7a92-4f9a-a291-394d6f7d75ba): created successfully Apr 29 06:38:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88508bdc-e2ce-4a35-89d1-b96023fd8fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Flow 'volume_create_manager' (51f339f0-dc0e-4354-99df-038ca24eb522) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:38:43 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-df33cb8c-c6b5-4673-8142-295e28bf930f tempest-VolumesDeleteCascade-1152844135 None] Created volume successfully. Apr 29 06:38:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-852b053f-6e13-479c-94e9-26457eb48da5 tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:38:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-852b053f-6e13-479c-94e9-26457eb48da5 tempest-VolumesDeleteCascade-1152844135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:38:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-852b053f-6e13-479c-94e9-26457eb48da5 tempest-VolumesDeleteCascade-1152844135 None] Creating offline snapshot 731febb4-4ce1-4691-a77b-b492c63f99c0 of volume 664f01f9-7a92-4f9a-a291-394d6f7d75ba {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:38:44 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7917ee-716f-4815-b087-b401495971c5]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:38:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-852b053f-6e13-479c-94e9-26457eb48da5 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:44 devstack sudo[87171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba Apr 29 06:38:44 devstack sudo[87171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:45 devstack sudo[87171]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-852b053f-6e13-479c-94e9-26457eb48da5 tempest-VolumesDeleteCascade-1152844135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba" returned: 0 in 0.842s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-852b053f-6e13-479c-94e9-26457eb48da5 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:45 devstack sudo[87176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0 1G Apr 29 06:38:45 devstack sudo[87176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:46 devstack sudo[87176]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-852b053f-6e13-479c-94e9-26457eb48da5 tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0 1G" returned: 0 in 1.126s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-852b053f-6e13-479c-94e9-26457eb48da5 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:46 devstack sudo[87189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0 Apr 29 06:38:46 devstack sudo[87189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:48 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:38:48 devstack sudo[87189]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Flow 'volume_create_manager' (d87ebf87-719c-4ed1-8c8a-e968594d46b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:38:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86076927-ca31-4ce3-b8c2-729947b5ce80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-852b053f-6e13-479c-94e9-26457eb48da5 tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0" returned: 0 in 1.599s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:48 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-852b053f-6e13-479c-94e9-26457eb48da5 tempest-VolumesDeleteCascade-1152844135 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0 is being set with open permissions: ugo+rw Apr 29 06:38:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-852b053f-6e13-479c-94e9-26457eb48da5 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86076927-ca31-4ce3-b8c2-729947b5ce80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1977917344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fead673f-6ecf-4cf0-afa7-67034d57e6fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6932aefddb49be84fb25f186a70c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:38:48Z,use_quota=True,user_id='ff8656b6dd9a41bb85b98e057e08ec25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d394d80-11b1-4044-a588-6fee506c53f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d394d80-11b1-4044-a588-6fee506c53f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:48 devstack sudo[87218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0 Apr 29 06:38:48 devstack sudo[87218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (919e56ae-544d-4b02-ba36-feb9710c3b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (919e56ae-544d-4b02-ba36-feb9710c3b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fead673f-6ecf-4cf0-afa7-67034d57e6fe', 'volume_name': 'volume-fead673f-6ecf-4cf0-afa7-67034d57e6fe', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611e3b00-ec11-4df9-aa0b-805d5d721c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611e3b00-ec11-4df9-aa0b-805d5d721c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86e1776-9d19-4322-b031-8661725e8055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:48 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Volume fead673f-6ecf-4cf0-afa7-67034d57e6fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fead673f-6ecf-4cf0-afa7-67034d57e6fe', 'volume_size': 1} Apr 29 06:38:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:38:49 devstack sudo[87218]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-852b053f-6e13-479c-94e9-26457eb48da5 tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0" returned: 0 in 1.495s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-852b053f-6e13-479c-94e9-26457eb48da5 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:49 devstack sudo[87237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.info Apr 29 06:38:49 devstack sudo[87237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:50 devstack sudo[87237]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-852b053f-6e13-479c-94e9-26457eb48da5 tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.info" returned: 0 in 1.038s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:50 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-852b053f-6e13-479c-94e9-26457eb48da5 tempest-VolumesDeleteCascade-1152844135 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.info is being set with open permissions: ugo+rw Apr 29 06:38:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-852b053f-6e13-479c-94e9-26457eb48da5 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:50 devstack sudo[87260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.info Apr 29 06:38:50 devstack sudo[87260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:52 devstack sudo[87260]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-852b053f-6e13-479c-94e9-26457eb48da5 tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.info" returned: 0 in 1.161s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-852b053f-6e13-479c-94e9-26457eb48da5 tempest-VolumesDeleteCascade-1152844135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.436s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:38:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.718s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:38:52 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1977917344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fead673f-6ecf-4cf0-afa7-67034d57e6fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6932aefddb49be84fb25f186a70c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:38:48Z,use_quota=True,user_id='ff8656b6dd9a41bb85b98e057e08ec25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:38:52 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Creating volume fead673f-6ecf-4cf0-afa7-67034d57e6fe {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:38:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:38:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:38:52 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:38:52 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:38:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:38:52 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:38:52 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:38:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fead673f-6ecf-4cf0-afa7-67034d57e6fe 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:52 devstack sudo[87311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fead673f-6ecf-4cf0-afa7-67034d57e6fe 1073741824 Apr 29 06:38:52 devstack sudo[87311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:52 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-852b053f-6e13-479c-94e9-26457eb48da5 tempest-VolumesDeleteCascade-1152844135 None] Create snapshot completed successfully Apr 29 06:38:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-aca76356-d8f4-410f-9262-c9e700af1371 tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:38:53 devstack sudo[87311]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fead673f-6ecf-4cf0-afa7-67034d57e6fe 1073741824" returned: 0 in 1.383s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fead673f-6ecf-4cf0-afa7-67034d57e6fe {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:53 devstack sudo[87323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fead673f-6ecf-4cf0-afa7-67034d57e6fe Apr 29 06:38:53 devstack sudo[87323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:54 devstack sudo[87323]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fead673f-6ecf-4cf0-afa7-67034d57e6fe" returned: 0 in 0.646s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:54 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] <== create_volume: return (2096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:38:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.099s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:38:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-aca76356-d8f4-410f-9262-c9e700af1371 tempest-VolumesDeleteCascade-1152844135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.501s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:38:54 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86e1776-9d19-4322-b031-8661725e8055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fead673f-6ecf-4cf0-afa7-67034d57e6fe', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:54 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e10c001-6fd4-428e-aa98-5a4a8ecc94f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:38:54 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-aca76356-d8f4-410f-9262-c9e700af1371 tempest-VolumesDeleteCascade-1152844135 None] Creating offline snapshot bb321c9e-d800-4039-80e9-81111b7ee72e of volume 664f01f9-7a92-4f9a-a291-394d6f7d75ba {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:38:54 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Volume volume-fead673f-6ecf-4cf0-afa7-67034d57e6fe (fead673f-6ecf-4cf0-afa7-67034d57e6fe): created successfully Apr 29 06:38:54 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e10c001-6fd4-428e-aa98-5a4a8ecc94f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:38:54 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Flow 'volume_create_manager' (d87ebf87-719c-4ed1-8c8a-e968594d46b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:38:54 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8085de-2390-48a4-b360-b66b832ed1ce]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:38:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-aca76356-d8f4-410f-9262-c9e700af1371 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:54 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-1b3047cc-283a-4d8d-985b-ca3e5f28f25c tempest-VolumesActionsTest-1300197604 None] Created volume successfully. Apr 29 06:38:54 devstack sudo[87329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0 Apr 29 06:38:54 devstack sudo[87329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:54 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f5ae520a-c024-43b3-9670-49f7bb83f407 tempest-VolumesActionsTest-1300197604 None] Acquiring lock "cinder-fead673f-6ecf-4cf0-afa7-67034d57e6fe" by "attach_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:38:54 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f5ae520a-c024-43b3-9670-49f7bb83f407 tempest-VolumesActionsTest-1300197604 None] Lock "cinder-fead673f-6ecf-4cf0-afa7-67034d57e6fe" acquired by "attach_volume" :: waited 0.021s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:38:55 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-f5ae520a-c024-43b3-9670-49f7bb83f407 tempest-VolumesActionsTest-1300197604 None] Attaching volume fead673f-6ecf-4cf0-afa7-67034d57e6fe to instance 31b3c64f-11a7-4112-9006-9fc64bda17bf at mountpoint /dev/vdb on host None. Apr 29 06:38:55 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-f5ae520a-c024-43b3-9670-49f7bb83f407 tempest-VolumesActionsTest-1300197604 None] Attach volume completed successfully. Apr 29 06:38:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f5ae520a-c024-43b3-9670-49f7bb83f407 tempest-VolumesActionsTest-1300197604 None] Lock "cinder-fead673f-6ecf-4cf0-afa7-67034d57e6fe" released by "attach_volume" :: held 0.100s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:38:55 devstack sudo[87329]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-aca76356-d8f4-410f-9262-c9e700af1371 tempest-VolumesDeleteCascade-1152844135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0" returned: 0 in 0.911s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:55 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-aca76356-d8f4-410f-9262-c9e700af1371 tempest-VolumesDeleteCascade-1152844135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:38:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-aca76356-d8f4-410f-9262-c9e700af1371 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.bb321c9e-d800-4039-80e9-81111b7ee72e 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:55 devstack sudo[87334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.bb321c9e-d800-4039-80e9-81111b7ee72e 1G Apr 29 06:38:55 devstack sudo[87334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:56 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-3c349aff-4108-43d8-9b60-2e46e7c0f257 tempest-VolumesActionsTest-340776006 None] Terminate volume connection completed successfully. Apr 29 06:38:57 devstack sudo[87334]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-aca76356-d8f4-410f-9262-c9e700af1371 tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.bb321c9e-d800-4039-80e9-81111b7ee72e 1G" returned: 0 in 1.924s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-aca76356-d8f4-410f-9262-c9e700af1371 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.bb321c9e-d800-4039-80e9-81111b7ee72e {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:57 devstack sudo[87428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.bb321c9e-d800-4039-80e9-81111b7ee72e Apr 29 06:38:57 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:57 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3c349aff-4108-43d8-9b60-2e46e7c0f257 tempest-VolumesActionsTest-340776006 None] Acquiring lock "cinder-fead673f-6ecf-4cf0-afa7-67034d57e6fe-detach_volume" by "detach_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:38:57 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3c349aff-4108-43d8-9b60-2e46e7c0f257 tempest-VolumesActionsTest-340776006 None] Lock "cinder-fead673f-6ecf-4cf0-afa7-67034d57e6fe-detach_volume" acquired by "detach_volume" :: waited 0.093s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:38:57 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-3c349aff-4108-43d8-9b60-2e46e7c0f257 tempest-VolumesActionsTest-340776006 None] Detaching volume fead673f-6ecf-4cf0-afa7-67034d57e6fe from instance 31b3c64f-11a7-4112-9006-9fc64bda17bf. Apr 29 06:38:57 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-3c349aff-4108-43d8-9b60-2e46e7c0f257 tempest-VolumesActionsTest-340776006 None] Detach volume completed successfully. Apr 29 06:38:57 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3c349aff-4108-43d8-9b60-2e46e7c0f257 tempest-VolumesActionsTest-340776006 None] Lock "cinder-fead673f-6ecf-4cf0-afa7-67034d57e6fe-detach_volume" released by "detach_volume" :: held 0.217s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:38:58 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8393c13e-a47f-421f-9571-5c18c96039e2 tempest-VolumesActionsTest-1300197604 None] Acquiring lock "cinder-fead673f-6ecf-4cf0-afa7-67034d57e6fe-detach_volume" by "detach_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:38:58 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8393c13e-a47f-421f-9571-5c18c96039e2 tempest-VolumesActionsTest-1300197604 None] Lock "cinder-fead673f-6ecf-4cf0-afa7-67034d57e6fe-detach_volume" acquired by "detach_volume" :: waited 0.068s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:38:58 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-8393c13e-a47f-421f-9571-5c18c96039e2 tempest-VolumesActionsTest-1300197604 None] Volume detach called, but volume not attached. Apr 29 06:38:58 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8393c13e-a47f-421f-9571-5c18c96039e2 tempest-VolumesActionsTest-1300197604 None] Lock "cinder-fead673f-6ecf-4cf0-afa7-67034d57e6fe-detach_volume" released by "detach_volume" :: held 0.065s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:38:59 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root Apr 29 06:38:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-aca76356-d8f4-410f-9262-c9e700af1371 tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.bb321c9e-d800-4039-80e9-81111b7ee72e" returned: 0 in 2.103s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:38:59 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-aca76356-d8f4-410f-9262-c9e700af1371 tempest-VolumesDeleteCascade-1152844135 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.bb321c9e-d800-4039-80e9-81111b7ee72e is being set with open permissions: ugo+rw Apr 29 06:38:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-aca76356-d8f4-410f-9262-c9e700af1371 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.bb321c9e-d800-4039-80e9-81111b7ee72e {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:38:59 devstack sudo[87530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.bb321c9e-d800-4039-80e9-81111b7ee72e Apr 29 06:38:59 devstack sudo[87530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:38:59 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9b5fa6e1-af5a-40c1-828f-db1ad0dc6063 tempest-VolumesActionsTest-1300197604 None] Acquiring lock "cinder-fead673f-6ecf-4cf0-afa7-67034d57e6fe-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:38:59 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9b5fa6e1-af5a-40c1-828f-db1ad0dc6063 tempest-VolumesActionsTest-1300197604 None] Lock "cinder-fead673f-6ecf-4cf0-afa7-67034d57e6fe-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:38:59 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9b5fa6e1-af5a-40c1-828f-db1ad0dc6063 tempest-VolumesActionsTest-1300197604 None] Acquiring lock "cinder-quobyte-fead673f-6ecf-4cf0-afa7-67034d57e6fe" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:38:59 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9b5fa6e1-af5a-40c1-828f-db1ad0dc6063 tempest-VolumesActionsTest-1300197604 None] Lock "cinder-quobyte-fead673f-6ecf-4cf0-afa7-67034d57e6fe" acquired by "delete_volume" :: waited 0.024s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:38:59 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7b0a0f-52f4-457c-9379-b5560274174c]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:38:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9b5fa6e1-af5a-40c1-828f-db1ad0dc6063 tempest-VolumesActionsTest-1300197604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fead673f-6ecf-4cf0-afa7-67034d57e6fe {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:00 devstack sudo[87540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fead673f-6ecf-4cf0-afa7-67034d57e6fe Apr 29 06:39:00 devstack sudo[87540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:01 devstack sudo[87530]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-aca76356-d8f4-410f-9262-c9e700af1371 tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.bb321c9e-d800-4039-80e9-81111b7ee72e" returned: 0 in 1.763s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-aca76356-d8f4-410f-9262-c9e700af1371 tempest-VolumesDeleteCascade-1152844135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.871s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:39:01 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-aca76356-d8f4-410f-9262-c9e700af1371 tempest-VolumesDeleteCascade-1152844135 None] Create snapshot completed successfully Apr 29 06:39:01 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "cinder-664f01f9-7a92-4f9a-a291-394d6f7d75ba-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:39:01 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-664f01f9-7a92-4f9a-a291-394d6f7d75ba-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:39:01 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Performing cascade delete. {{(pid=84195) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 29 06:39:01 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "cinder-731febb4-4ce1-4691-a77b-b492c63f99c0-delete_snapshot" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:39:01 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-731febb4-4ce1-4691-a77b-b492c63f99c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:39:01 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "cinder-quobyte-664f01f9-7a92-4f9a-a291-394d6f7d75ba" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:39:01 devstack sudo[87540]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9b5fa6e1-af5a-40c1-828f-db1ad0dc6063 tempest-VolumesActionsTest-1300197604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fead673f-6ecf-4cf0-afa7-67034d57e6fe" returned: 0 in 2.014s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9b5fa6e1-af5a-40c1-828f-db1ad0dc6063 tempest-VolumesActionsTest-1300197604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fead673f-6ecf-4cf0-afa7-67034d57e6fe {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:01 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-quobyte-664f01f9-7a92-4f9a-a291-394d6f7d75ba" acquired by "delete_snapshot" :: waited 0.076s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:39:01 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "cinder-quobyte-731febb4-4ce1-4691-a77b-b492c63f99c0" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:39:01 devstack sudo[87557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fead673f-6ecf-4cf0-afa7-67034d57e6fe Apr 29 06:39:01 devstack sudo[87557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:02 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-quobyte-731febb4-4ce1-4691-a77b-b492c63f99c0" acquired by "_delete_snapshot" :: waited 0.074s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:39:02 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Deleting offline snapshot 731febb4-4ce1-4691-a77b-b492c63f99c0 of volume 664f01f9-7a92-4f9a-a291-394d6f7d75ba {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:39:02 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] snapshot_file for this snap is: volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:39:02 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6d83b8-7809-4d78-a0d6-fc21d82ebd07]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:39:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:02 devstack sudo[87559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0 Apr 29 06:39:02 devstack sudo[87559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:02 devstack sudo[87557]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9b5fa6e1-af5a-40c1-828f-db1ad0dc6063 tempest-VolumesActionsTest-1300197604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fead673f-6ecf-4cf0-afa7-67034d57e6fe" returned: 0 in 1.078s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:03 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9b5fa6e1-af5a-40c1-828f-db1ad0dc6063 tempest-VolumesActionsTest-1300197604 None] Lock "cinder-quobyte-fead673f-6ecf-4cf0-afa7-67034d57e6fe" released by "delete_volume" :: held 3.209s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:39:03 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-9b5fa6e1-af5a-40c1-828f-db1ad0dc6063 tempest-VolumesActionsTest-1300197604 None] Created reservations ['b9cd122f-28fa-4667-a2f0-aa290c56bdad', 'bfc0d0fc-276c-4220-ba40-3e84faa20128', '0bf05314-a17c-4aa2-8242-5ab2fd67d6e9', 'cffea92b-7f6e-4ef8-85bc-b242aa48ca2c'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:39:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9b5fa6e1-af5a-40c1-828f-db1ad0dc6063 tempest-VolumesActionsTest-1300197604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:39:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9b5fa6e1-af5a-40c1-828f-db1ad0dc6063 tempest-VolumesActionsTest-1300197604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:39:03 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9b5fa6e1-af5a-40c1-828f-db1ad0dc6063 tempest-VolumesActionsTest-1300197604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:39:03 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9b5fa6e1-af5a-40c1-828f-db1ad0dc6063 tempest-VolumesActionsTest-1300197604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:39:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9b5fa6e1-af5a-40c1-828f-db1ad0dc6063 tempest-VolumesActionsTest-1300197604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:39:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9b5fa6e1-af5a-40c1-828f-db1ad0dc6063 tempest-VolumesActionsTest-1300197604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:03 devstack sudo[87563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:39:03 devstack sudo[87563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:03 devstack sudo[87559]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0" returned: 0 in 1.868s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:39:04 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[2717f65c-f099-4331-8f5e-05bc53b2d52a]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:39:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:04 devstack sudo[87568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba Apr 29 06:39:04 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:05 devstack sudo[87563]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9b5fa6e1-af5a-40c1-828f-db1ad0dc6063 tempest-VolumesActionsTest-1300197604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 2.375s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:05 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-9b5fa6e1-af5a-40c1-828f-db1ad0dc6063 tempest-VolumesActionsTest-1300197604 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:39:05 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-9b5fa6e1-af5a-40c1-828f-db1ad0dc6063 tempest-VolumesActionsTest-1300197604 None] Deleted volume successfully. Apr 29 06:39:06 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9b5fa6e1-af5a-40c1-828f-db1ad0dc6063 tempest-VolumesActionsTest-1300197604 None] Lock "cinder-fead673f-6ecf-4cf0-afa7-67034d57e6fe-delete_volume" released by "delete_volume" :: held 6.329s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:39:07 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba" returned: 0 in 3.128s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:07 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0fa49e-0ed6-413d-a43c-b03b5052f476]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:39:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.bb321c9e-d800-4039-80e9-81111b7ee72e {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:07 devstack sudo[87682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.bb321c9e-d800-4039-80e9-81111b7ee72e Apr 29 06:39:07 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:09 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.bb321c9e-d800-4039-80e9-81111b7ee72e" returned: 0 in 1.861s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:09 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:39:09 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7595bc-39b1-4dde-b37b-33592d5363c1]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:39:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:09 devstack sudo[87694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0 Apr 29 06:39:09 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:11 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0" returned: 0 in 1.814s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:11 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:39:11 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7b5696-2de8-4171-8a14-6744daecf029]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:39:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:11 devstack sudo[87703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba Apr 29 06:39:11 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:12 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba" returned: 0 in 1.422s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:12 devstack sudo[87741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0 Apr 29 06:39:12 devstack sudo[87741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:13 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:SELECT=57,cinder:UPDATE=54,cinder:INSERT=8,cinder:DELETE=7 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:39:13 devstack sudo[87741]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0" returned: 0 in 1.243s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:13 devstack sudo[87760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0 Apr 29 06:39:13 devstack sudo[87760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:14 devstack sudo[87760]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.731febb4-4ce1-4691-a77b-b492c63f99c0" returned: 0 in 0.667s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.bb321c9e-d800-4039-80e9-81111b7ee72e -F qcow2 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:14 devstack sudo[87765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.bb321c9e-d800-4039-80e9-81111b7ee72e -F qcow2 Apr 29 06:39:14 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:SELECT=53,cinder:UPDATE=55,cinder:INSERT=17,cinder:DELETE=4 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Flow 'volume_create_manager' (a3814a35-2dde-4549-8484-8739fe1a969e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be1ef05a-4d4b-4499-8210-033a80ab4585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be1ef05a-4d4b-4499-8210-033a80ab4585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1569759833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d69bf73-42d8-463c-927d-d365ec3d0bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6932aefddb49be84fb25f186a70c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:39:15Z,use_quota=True,user_id='ff8656b6dd9a41bb85b98e057e08ec25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a654ed51-cc04-4e31-b655-e156f31ca3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a654ed51-cc04-4e31-b655-e156f31ca3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8546af-9b86-4a02-9e1a-8b3ffffa6107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8546af-9b86-4a02-9e1a-8b3ffffa6107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d69bf73-42d8-463c-927d-d365ec3d0bdd', 'volume_name': 'volume-7d69bf73-42d8-463c-927d-d365ec3d0bdd', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9cfbe46-0661-4012-bebc-ef3b143a401e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9cfbe46-0661-4012-bebc-ef3b143a401e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7376d7-091f-43a9-9b3e-7d2be43154d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:15 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Volume 7d69bf73-42d8-463c-927d-d365ec3d0bdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d69bf73-42d8-463c-927d-d365ec3d0bdd', 'volume_size': 1} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1569759833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d69bf73-42d8-463c-927d-d365ec3d0bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6932aefddb49be84fb25f186a70c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:39:15Z,use_quota=True,user_id='ff8656b6dd9a41bb85b98e057e08ec25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Creating volume 7d69bf73-42d8-463c-927d-d365ec3d0bdd {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:39:15 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7d69bf73-42d8-463c-927d-d365ec3d0bdd 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:15 devstack sudo[87771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7d69bf73-42d8-463c-927d-d365ec3d0bdd 1073741824 Apr 29 06:39:15 devstack sudo[87771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:15 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.bb321c9e-d800-4039-80e9-81111b7ee72e -F qcow2" returned: 0 in 0.948s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-quobyte-731febb4-4ce1-4691-a77b-b492c63f99c0" released by "_delete_snapshot" :: held 13.453s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-quobyte-664f01f9-7a92-4f9a-a291-394d6f7d75ba" released by "delete_snapshot" :: held 13.541s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Created reservations ['45ab9117-267c-4e02-827f-2a81daccc7de', 'f9d837ae-b7e5-4a2e-83f7-3b3a147ddefe', 'e5270ee1-b982-4f90-bcac-3b3ccd4e1055', '4407888a-3a89-402c-ac6f-b9a72a056354'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:39:15 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Delete snapshot completed successfully. Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-731febb4-4ce1-4691-a77b-b492c63f99c0-delete_snapshot" released by "delete_snapshot" :: held 13.799s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "cinder-bb321c9e-d800-4039-80e9-81111b7ee72e-delete_snapshot" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-bb321c9e-d800-4039-80e9-81111b7ee72e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "cinder-quobyte-664f01f9-7a92-4f9a-a291-394d6f7d75ba" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-quobyte-664f01f9-7a92-4f9a-a291-394d6f7d75ba" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "cinder-quobyte-bb321c9e-d800-4039-80e9-81111b7ee72e" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-quobyte-bb321c9e-d800-4039-80e9-81111b7ee72e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Deleting offline snapshot bb321c9e-d800-4039-80e9-81111b7ee72e of volume 664f01f9-7a92-4f9a-a291-394d6f7d75ba {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] snapshot_file for this snap is: volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.bb321c9e-d800-4039-80e9-81111b7ee72e {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1c29f7-7a85-4431-a11d-7119e8aed5a7]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:39:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.bb321c9e-d800-4039-80e9-81111b7ee72e {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:15 devstack sudo[87780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.bb321c9e-d800-4039-80e9-81111b7ee72e Apr 29 06:39:15 devstack sudo[87780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:16 devstack sudo[87771]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7d69bf73-42d8-463c-927d-d365ec3d0bdd 1073741824" returned: 0 in 1.019s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7d69bf73-42d8-463c-927d-d365ec3d0bdd {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:16 devstack sudo[87811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7d69bf73-42d8-463c-927d-d365ec3d0bdd Apr 29 06:39:16 devstack sudo[87811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:16 devstack sudo[87780]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.bb321c9e-d800-4039-80e9-81111b7ee72e" returned: 0 in 0.855s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:16 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:39:16 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c87ef7-d011-4893-86ad-575c23b3f03a]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:39:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:16 devstack sudo[87816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba Apr 29 06:39:16 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:17 devstack sudo[87811]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7d69bf73-42d8-463c-927d-d365ec3d0bdd" returned: 0 in 0.858s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:17 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] <== create_volume: return (1950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:39:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:39:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7376d7-091f-43a9-9b3e-7d2be43154d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d69bf73-42d8-463c-927d-d365ec3d0bdd', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6e6555-8024-462f-87b3-7ebb191fd5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:17 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Volume volume-7d69bf73-42d8-463c-927d-d365ec3d0bdd (7d69bf73-42d8-463c-927d-d365ec3d0bdd): created successfully Apr 29 06:39:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6e6555-8024-462f-87b3-7ebb191fd5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Flow 'volume_create_manager' (a3814a35-2dde-4549-8484-8739fe1a969e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:39:17 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-c87c5242-286d-49aa-851b-80072c199939 tempest-VolumesActionsTest-1300197604 None] Created volume successfully. Apr 29 06:39:17 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba" returned: 0 in 0.955s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.bb321c9e-d800-4039-80e9-81111b7ee72e {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:17 devstack sudo[87862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.bb321c9e-d800-4039-80e9-81111b7ee72e Apr 29 06:39:17 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:18 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.bb321c9e-d800-4039-80e9-81111b7ee72e" returned: 0 in 0.919s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.bb321c9e-d800-4039-80e9-81111b7ee72e {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:18 devstack sudo[87869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.bb321c9e-d800-4039-80e9-81111b7ee72e Apr 29 06:39:18 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:18 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-cae83c00-f90d-4b56-8342-6ed5fae62512 tempest-VolumesActionsTest-340776006 None] Acquiring lock "cinder-7d69bf73-42d8-463c-927d-d365ec3d0bdd-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:39:18 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-cae83c00-f90d-4b56-8342-6ed5fae62512 tempest-VolumesActionsTest-340776006 None] Lock "cinder-7d69bf73-42d8-463c-927d-d365ec3d0bdd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:39:18 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-cae83c00-f90d-4b56-8342-6ed5fae62512 tempest-VolumesActionsTest-340776006 None] Acquiring lock "cinder-quobyte-7d69bf73-42d8-463c-927d-d365ec3d0bdd" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:39:18 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-cae83c00-f90d-4b56-8342-6ed5fae62512 tempest-VolumesActionsTest-340776006 None] Lock "cinder-quobyte-7d69bf73-42d8-463c-927d-d365ec3d0bdd" acquired by "delete_volume" :: waited 0.027s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:39:18 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf92fdc-a67b-4d45-9828-337702f2e471]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:39:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-cae83c00-f90d-4b56-8342-6ed5fae62512 tempest-VolumesActionsTest-340776006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7d69bf73-42d8-463c-927d-d365ec3d0bdd {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:19 devstack sudo[87871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7d69bf73-42d8-463c-927d-d365ec3d0bdd Apr 29 06:39:19 devstack sudo[87871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:19 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba.bb321c9e-d800-4039-80e9-81111b7ee72e" returned: 0 in 1.419s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:20 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-quobyte-bb321c9e-d800-4039-80e9-81111b7ee72e" released by "_delete_snapshot" :: held 4.330s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:39:20 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-quobyte-664f01f9-7a92-4f9a-a291-394d6f7d75ba" released by "delete_snapshot" :: held 4.366s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:39:20 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Created reservations ['de959250-bf2a-4289-aacf-b7a932f2c314', '2c90213f-d1af-4ccf-8ccb-b71a8d12642b', 'b72da2c6-f218-4b4e-8d7d-725c5924667f', 'f148016d-03e0-40cc-a3e3-e3fb10ef24dc'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:39:20 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Delete snapshot completed successfully. Apr 29 06:39:20 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-bb321c9e-d800-4039-80e9-81111b7ee72e-delete_snapshot" released by "delete_snapshot" :: held 4.699s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:39:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Snapshots deleted, issuing volume delete {{(pid=84195) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 29 06:39:20 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "cinder-quobyte-664f01f9-7a92-4f9a-a291-394d6f7d75ba" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:39:20 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-quobyte-664f01f9-7a92-4f9a-a291-394d6f7d75ba" acquired by "delete_volume" :: waited 0.038s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:39:20 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ab9b19-882a-46a8-b46a-ce85ffe2f57e]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:39:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:20 devstack sudo[87911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba Apr 29 06:39:20 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:20 devstack sudo[87871]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-cae83c00-f90d-4b56-8342-6ed5fae62512 tempest-VolumesActionsTest-340776006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7d69bf73-42d8-463c-927d-d365ec3d0bdd" returned: 0 in 2.008s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-cae83c00-f90d-4b56-8342-6ed5fae62512 tempest-VolumesActionsTest-340776006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7d69bf73-42d8-463c-927d-d365ec3d0bdd {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:21 devstack sudo[87928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7d69bf73-42d8-463c-927d-d365ec3d0bdd Apr 29 06:39:21 devstack sudo[87928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Flow 'volume_create_manager' (38446592-84bf-46da-93d3-eca1bab8f078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a91343e6-08e7-49b9-a793-d875407ee383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a91343e6-08e7-49b9-a793-d875407ee383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-925866792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dacca973-31cb-4ded-ac74-d4a4553f51c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e3f9ee27f542bbafc8aa9457b41572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:39:22Z,use_quota=True,user_id='ed3393b3d0d0410db45bf7f1a862c88e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c826f6-7633-498e-97c2-085617463225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c826f6-7633-498e-97c2-085617463225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2d3918f-7080-4e7e-a08f-d84368b55aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2d3918f-7080-4e7e-a08f-d84368b55aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dacca973-31cb-4ded-ac74-d4a4553f51c7', 'volume_name': 'volume-dacca973-31cb-4ded-ac74-d4a4553f51c7', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f313963d-99e0-42d1-95fd-1b801c92f35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f313963d-99e0-42d1-95fd-1b801c92f35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a11000-84a9-4fa0-87ad-f7fe18e07b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:22 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Volume dacca973-31cb-4ded-ac74-d4a4553f51c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dacca973-31cb-4ded-ac74-d4a4553f51c7', 'volume_size': 1} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-925866792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dacca973-31cb-4ded-ac74-d4a4553f51c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e3f9ee27f542bbafc8aa9457b41572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:39:22Z,use_quota=True,user_id='ed3393b3d0d0410db45bf7f1a862c88e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Creating volume dacca973-31cb-4ded-ac74-d4a4553f51c7 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:39:22 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-dacca973-31cb-4ded-ac74-d4a4553f51c7 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:22 devstack sudo[87954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-dacca973-31cb-4ded-ac74-d4a4553f51c7 1073741824 Apr 29 06:39:22 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:22 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba" returned: 0 in 1.832s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:22 devstack sudo[87960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba Apr 29 06:39:22 devstack sudo[87960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:22 devstack sudo[87928]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-cae83c00-f90d-4b56-8342-6ed5fae62512 tempest-VolumesActionsTest-340776006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7d69bf73-42d8-463c-927d-d365ec3d0bdd" returned: 0 in 1.679s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-cae83c00-f90d-4b56-8342-6ed5fae62512 tempest-VolumesActionsTest-340776006 None] Lock "cinder-quobyte-7d69bf73-42d8-463c-927d-d365ec3d0bdd" released by "delete_volume" :: held 3.775s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-cae83c00-f90d-4b56-8342-6ed5fae62512 tempest-VolumesActionsTest-340776006 None] Created reservations ['4b11c8de-6dfb-46bf-819c-40aef13bd554', '32a77115-87f7-4ee3-a4b2-2dfd12b62a6e', 'aa2b4af4-ce2d-4c9c-b81a-74e03d58f020', 'fc56df2b-470f-4cdf-b74b-dd1dd0217cd5'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-cae83c00-f90d-4b56-8342-6ed5fae62512 tempest-VolumesActionsTest-340776006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-cae83c00-f90d-4b56-8342-6ed5fae62512 tempest-VolumesActionsTest-340776006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-cae83c00-f90d-4b56-8342-6ed5fae62512 tempest-VolumesActionsTest-340776006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-cae83c00-f90d-4b56-8342-6ed5fae62512 tempest-VolumesActionsTest-340776006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-cae83c00-f90d-4b56-8342-6ed5fae62512 tempest-VolumesActionsTest-340776006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:39:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-cae83c00-f90d-4b56-8342-6ed5fae62512 tempest-VolumesActionsTest-340776006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:22 devstack sudo[87971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:39:22 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:23 devstack sudo[87960]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-664f01f9-7a92-4f9a-a291-394d6f7d75ba" returned: 0 in 1.259s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:23 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-quobyte-664f01f9-7a92-4f9a-a291-394d6f7d75ba" released by "delete_volume" :: held 3.280s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:39:23 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Created reservations ['e30b58fd-9048-4aa8-b560-9aae9759790b', '4a0e37c4-2463-4dc5-a43f-1cadb969701d', 'd6125be5-ad8a-4b16-a4cc-0aaf13a80317', '112938cc-4222-46c9-a2c3-6649663d2fce'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:39:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:39:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:39:24 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:39:24 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:39:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:39:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:24 devstack sudo[87985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:39:24 devstack sudo[87985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:24 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-dacca973-31cb-4ded-ac74-d4a4553f51c7 1073741824" returned: 0 in 2.221s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:24 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-cae83c00-f90d-4b56-8342-6ed5fae62512 tempest-VolumesActionsTest-340776006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 1.630s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:24 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-cae83c00-f90d-4b56-8342-6ed5fae62512 tempest-VolumesActionsTest-340776006 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:39:24 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-cae83c00-f90d-4b56-8342-6ed5fae62512 tempest-VolumesActionsTest-340776006 None] Deleted volume successfully. Apr 29 06:39:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-dacca973-31cb-4ded-ac74-d4a4553f51c7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:24 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-cae83c00-f90d-4b56-8342-6ed5fae62512 tempest-VolumesActionsTest-340776006 None] Lock "cinder-7d69bf73-42d8-463c-927d-d365ec3d0bdd-delete_volume" released by "delete_volume" :: held 5.943s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:39:24 devstack sudo[87988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-dacca973-31cb-4ded-ac74-d4a4553f51c7 Apr 29 06:39:24 devstack sudo[87988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:25 devstack sudo[87985]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.964s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:25 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:39:25 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Deleted volume successfully. Apr 29 06:39:25 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:39:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Flow 'volume_create_manager' (fb75efd7-5877-4b65-8bda-e11804623dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:39:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e81008-b423-40e6-a47c-9130f48509d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:25 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93a58215-be32-43ce-ab7d-0f0ace6a6e22 tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-664f01f9-7a92-4f9a-a291-394d6f7d75ba-delete_volume" released by "delete_volume" :: held 23.617s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:39:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e81008-b423-40e6-a47c-9130f48509d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1932033647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f95ec7b-821a-4d0d-8a23-710c45c43170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6932aefddb49be84fb25f186a70c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:39:25Z,use_quota=True,user_id='ff8656b6dd9a41bb85b98e057e08ec25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06828ac9-2fe5-4eca-90de-4f4507cb434d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06828ac9-2fe5-4eca-90de-4f4507cb434d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06e24504-df76-4150-8643-181d9c510aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06e24504-df76-4150-8643-181d9c510aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f95ec7b-821a-4d0d-8a23-710c45c43170', 'volume_name': 'volume-3f95ec7b-821a-4d0d-8a23-710c45c43170', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b486609d-6f43-4ee4-a9d5-17ec39c16a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b486609d-6f43-4ee4-a9d5-17ec39c16a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99c67d06-0828-41d0-8f3b-844d9c7a4ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:25 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Volume 3f95ec7b-821a-4d0d-8a23-710c45c43170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f95ec7b-821a-4d0d-8a23-710c45c43170', 'volume_size': 1} Apr 29 06:39:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:39:26 devstack sudo[87988]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-dacca973-31cb-4ded-ac74-d4a4553f51c7" returned: 0 in 1.538s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] <== create_volume: return (3975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.982s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.800s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1932033647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f95ec7b-821a-4d0d-8a23-710c45c43170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6932aefddb49be84fb25f186a70c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:39:25Z,use_quota=True,user_id='ff8656b6dd9a41bb85b98e057e08ec25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Creating volume 3f95ec7b-821a-4d0d-8a23-710c45c43170 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:39:26 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3f95ec7b-821a-4d0d-8a23-710c45c43170 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a11000-84a9-4fa0-87ad-f7fe18e07b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dacca973-31cb-4ded-ac74-d4a4553f51c7', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:26 devstack sudo[87993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3f95ec7b-821a-4d0d-8a23-710c45c43170 1073741824 Apr 29 06:39:26 devstack sudo[87993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56511252-71f7-42ff-b8e3-b65f42b5543d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:26 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Volume volume-dacca973-31cb-4ded-ac74-d4a4553f51c7 (dacca973-31cb-4ded-ac74-d4a4553f51c7): created successfully Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56511252-71f7-42ff-b8e3-b65f42b5543d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Flow 'volume_create_manager' (38446592-84bf-46da-93d3-eca1bab8f078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:39:26 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-a3e9ed86-85e4-43b9-91fd-d4c46b166fd8 tempest-ServerRescueNegativeTestJSON-521609512 None] Created volume successfully. Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Flow 'volume_create_manager' (b87b0b9e-91dc-4041-b138-b80c2da7810a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd545a0f-e3ac-4f34-95dd-db9cfc2b8c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd545a0f-e3ac-4f34-95dd-db9cfc2b8c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-930249581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f59a77c1-3128-4f52-be2d-561197d4bbb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35b89ae6589a4387bfb065d0bb3f45c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:39:26Z,use_quota=True,user_id='9b308e89f10942f98c61536157d39df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (110e0d77-322a-4f5b-b5c9-6c0ce7118e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (110e0d77-322a-4f5b-b5c9-6c0ce7118e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e95bc3f-1b3c-480c-8197-332736840acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e95bc3f-1b3c-480c-8197-332736840acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f59a77c1-3128-4f52-be2d-561197d4bbb8', 'volume_name': 'volume-f59a77c1-3128-4f52-be2d-561197d4bbb8', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d03b6a0f-c7d4-4350-8f44-90d7ada3d3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d03b6a0f-c7d4-4350-8f44-90d7ada3d3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c2a8c85-eb72-4197-a414-e24313db67f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:26 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Volume f59a77c1-3128-4f52-be2d-561197d4bbb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f59a77c1-3128-4f52-be2d-561197d4bbb8', 'volume_size': 1} Apr 29 06:39:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:39:27 devstack sudo[87993]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3f95ec7b-821a-4d0d-8a23-710c45c43170 1073741824" returned: 0 in 1.009s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3f95ec7b-821a-4d0d-8a23-710c45c43170 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:27 devstack sudo[88003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3f95ec7b-821a-4d0d-8a23-710c45c43170 Apr 29 06:39:27 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:27 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3f95ec7b-821a-4d0d-8a23-710c45c43170" returned: 0 in 0.633s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:27 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:39:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:39:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.476s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:39:27 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-930249581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f59a77c1-3128-4f52-be2d-561197d4bbb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35b89ae6589a4387bfb065d0bb3f45c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:39:26Z,use_quota=True,user_id='9b308e89f10942f98c61536157d39df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:39:27 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Creating volume f59a77c1-3128-4f52-be2d-561197d4bbb8 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:39:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:39:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:39:27 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:39:27 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:39:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:39:27 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:39:27 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:39:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99c67d06-0828-41d0-8f3b-844d9c7a4ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f95ec7b-821a-4d0d-8a23-710c45c43170', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:27 devstack sudo[88006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8 1073741824 Apr 29 06:39:27 devstack sudo[88006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e319cf7-3c6e-4532-9313-3e5104f2278b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:27 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Volume volume-3f95ec7b-821a-4d0d-8a23-710c45c43170 (3f95ec7b-821a-4d0d-8a23-710c45c43170): created successfully Apr 29 06:39:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e319cf7-3c6e-4532-9313-3e5104f2278b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Flow 'volume_create_manager' (fb75efd7-5877-4b65-8bda-e11804623dd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:39:28 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-a815d30b-08f9-4786-9e65-ba75e794d0c0 tempest-VolumesActionsTest-1300197604 None] Created volume successfully. Apr 29 06:39:28 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9b6cd751-c019-40cf-8796-ca1c82a1d0fb tempest-VolumesActionsTest-340776006 None] Acquiring lock "cinder-3f95ec7b-821a-4d0d-8a23-710c45c43170-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:39:28 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9b6cd751-c019-40cf-8796-ca1c82a1d0fb tempest-VolumesActionsTest-340776006 None] Lock "cinder-3f95ec7b-821a-4d0d-8a23-710c45c43170-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:39:28 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9b6cd751-c019-40cf-8796-ca1c82a1d0fb tempest-VolumesActionsTest-340776006 None] Acquiring lock "cinder-quobyte-3f95ec7b-821a-4d0d-8a23-710c45c43170" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:39:29 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9b6cd751-c019-40cf-8796-ca1c82a1d0fb tempest-VolumesActionsTest-340776006 None] Lock "cinder-quobyte-3f95ec7b-821a-4d0d-8a23-710c45c43170" acquired by "delete_volume" :: waited 0.050s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:39:29 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dcdcd9-250e-4df3-9940-623f3a94f480]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:39:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9b6cd751-c019-40cf-8796-ca1c82a1d0fb tempest-VolumesActionsTest-340776006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3f95ec7b-821a-4d0d-8a23-710c45c43170 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:29 devstack sudo[88046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3f95ec7b-821a-4d0d-8a23-710c45c43170 Apr 29 06:39:29 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:29 devstack sudo[88006]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8 1073741824" returned: 0 in 1.781s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:29 devstack sudo[88050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8 Apr 29 06:39:29 devstack sudo[88050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:31 devstack sudo[88050]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8" returned: 0 in 1.323s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:31 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] <== create_volume: return (3187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:39:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.191s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:39:31 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c2a8c85-eb72-4197-a414-e24313db67f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f59a77c1-3128-4f52-be2d-561197d4bbb8', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:31 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:31 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d2c69e-80f9-470e-a59a-8571ef9b2fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9b6cd751-c019-40cf-8796-ca1c82a1d0fb tempest-VolumesActionsTest-340776006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3f95ec7b-821a-4d0d-8a23-710c45c43170" returned: 0 in 2.125s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9b6cd751-c019-40cf-8796-ca1c82a1d0fb tempest-VolumesActionsTest-340776006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3f95ec7b-821a-4d0d-8a23-710c45c43170 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:31 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Volume volume-f59a77c1-3128-4f52-be2d-561197d4bbb8 (f59a77c1-3128-4f52-be2d-561197d4bbb8): created successfully Apr 29 06:39:31 devstack sudo[88091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3f95ec7b-821a-4d0d-8a23-710c45c43170 Apr 29 06:39:31 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d2c69e-80f9-470e-a59a-8571ef9b2fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:31 devstack sudo[88091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:31 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Flow 'volume_create_manager' (b87b0b9e-91dc-4041-b138-b80c2da7810a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:39:31 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-f291cc0a-a818-4fed-b1f2-e687d6eb1451 tempest-VolumesDeleteCascade-1152844135 None] Created volume successfully. Apr 29 06:39:32 devstack sudo[88091]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9b6cd751-c019-40cf-8796-ca1c82a1d0fb tempest-VolumesActionsTest-340776006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3f95ec7b-821a-4d0d-8a23-710c45c43170" returned: 0 in 0.982s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:32 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9b6cd751-c019-40cf-8796-ca1c82a1d0fb tempest-VolumesActionsTest-340776006 None] Lock "cinder-quobyte-3f95ec7b-821a-4d0d-8a23-710c45c43170" released by "delete_volume" :: held 3.195s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:39:32 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-9b6cd751-c019-40cf-8796-ca1c82a1d0fb tempest-VolumesActionsTest-340776006 None] Created reservations ['4cda93c1-8e3e-4ea9-83a1-9b37a5a929dd', 'd2fe727a-4344-45d2-8131-c5762a618792', 'e55e934f-4523-417a-941d-5f062df94242', 'c7388a3d-bb20-414f-b928-b2b3d11c2a8f'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:39:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9b6cd751-c019-40cf-8796-ca1c82a1d0fb tempest-VolumesActionsTest-340776006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:39:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9b6cd751-c019-40cf-8796-ca1c82a1d0fb tempest-VolumesActionsTest-340776006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:39:32 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9b6cd751-c019-40cf-8796-ca1c82a1d0fb tempest-VolumesActionsTest-340776006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:39:32 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9b6cd751-c019-40cf-8796-ca1c82a1d0fb tempest-VolumesActionsTest-340776006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:39:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9b6cd751-c019-40cf-8796-ca1c82a1d0fb tempest-VolumesActionsTest-340776006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:39:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9b6cd751-c019-40cf-8796-ca1c82a1d0fb tempest-VolumesActionsTest-340776006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:32 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:39:32 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d5d7f0a6-b53c-4b82-a7eb-940d54147319 tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:39:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d5d7f0a6-b53c-4b82-a7eb-940d54147319 tempest-VolumesDeleteCascade-1152844135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.009s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:39:32 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-d5d7f0a6-b53c-4b82-a7eb-940d54147319 tempest-VolumesDeleteCascade-1152844135 None] Creating offline snapshot 00201b51-654d-40e2-936a-0640b5386fc5 of volume f59a77c1-3128-4f52-be2d-561197d4bbb8 {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:39:32 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1066ac-f415-4ad7-8dc1-44007668ff77]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:39:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d5d7f0a6-b53c-4b82-a7eb-940d54147319 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:33 devstack sudo[88138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8 Apr 29 06:39:33 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:33 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9b6cd751-c019-40cf-8796-ca1c82a1d0fb tempest-VolumesActionsTest-340776006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.891s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:33 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-9b6cd751-c019-40cf-8796-ca1c82a1d0fb tempest-VolumesActionsTest-340776006 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:39:33 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-9b6cd751-c019-40cf-8796-ca1c82a1d0fb tempest-VolumesActionsTest-340776006 None] Deleted volume successfully. Apr 29 06:39:33 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9b6cd751-c019-40cf-8796-ca1c82a1d0fb tempest-VolumesActionsTest-340776006 None] Lock "cinder-3f95ec7b-821a-4d0d-8a23-710c45c43170-delete_volume" released by "delete_volume" :: held 4.475s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:39:33 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:39:33 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Flow 'volume_create_manager' (0ca212a6-046a-4a35-a7ff-441b1316b893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:39:33 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f159e620-5877-4ea5-aff1-163d013a711c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:33 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f159e620-5877-4ea5-aff1-163d013a711c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1961985878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8c1eb88-14d6-4fda-bc3d-cad3f68fe482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6932aefddb49be84fb25f186a70c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:39:34Z,use_quota=True,user_id='ff8656b6dd9a41bb85b98e057e08ec25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:33 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19bf3a58-2177-459b-9336-3baf8408edde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:33 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19bf3a58-2177-459b-9336-3baf8408edde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:33 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08bab9af-53ac-45ba-8be3-a3c893ecc278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:33 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08bab9af-53ac-45ba-8be3-a3c893ecc278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8c1eb88-14d6-4fda-bc3d-cad3f68fe482', 'volume_name': 'volume-b8c1eb88-14d6-4fda-bc3d-cad3f68fe482', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:33 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9dbbf3-429c-47ce-9c80-1b857ce486a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:33 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9dbbf3-429c-47ce-9c80-1b857ce486a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:33 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb63848-2a20-47f3-9fed-fbdc37d0359d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:33 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Volume b8c1eb88-14d6-4fda-bc3d-cad3f68fe482: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8c1eb88-14d6-4fda-bc3d-cad3f68fe482', 'volume_size': 1} Apr 29 06:39:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:39:34 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d5d7f0a6-b53c-4b82-a7eb-940d54147319 tempest-VolumesDeleteCascade-1152844135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8" returned: 0 in 1.301s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d5d7f0a6-b53c-4b82-a7eb-940d54147319 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.00201b51-654d-40e2-936a-0640b5386fc5 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:34 devstack sudo[88145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.00201b51-654d-40e2-936a-0640b5386fc5 1G Apr 29 06:39:34 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:35 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d5d7f0a6-b53c-4b82-a7eb-940d54147319 tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.00201b51-654d-40e2-936a-0640b5386fc5 1G" returned: 0 in 0.854s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d5d7f0a6-b53c-4b82-a7eb-940d54147319 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f59a77c1-3128-4f52-be2d-561197d4bbb8 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.00201b51-654d-40e2-936a-0640b5386fc5 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:35 devstack sudo[88155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f59a77c1-3128-4f52-be2d-561197d4bbb8 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.00201b51-654d-40e2-936a-0640b5386fc5 Apr 29 06:39:35 devstack sudo[88155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:35 devstack sudo[88155]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d5d7f0a6-b53c-4b82-a7eb-940d54147319 tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f59a77c1-3128-4f52-be2d-561197d4bbb8 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.00201b51-654d-40e2-936a-0640b5386fc5" returned: 0 in 0.674s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:35 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-d5d7f0a6-b53c-4b82-a7eb-940d54147319 tempest-VolumesDeleteCascade-1152844135 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.00201b51-654d-40e2-936a-0640b5386fc5 is being set with open permissions: ugo+rw Apr 29 06:39:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d5d7f0a6-b53c-4b82-a7eb-940d54147319 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.00201b51-654d-40e2-936a-0640b5386fc5 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:35 devstack sudo[88160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.00201b51-654d-40e2-936a-0640b5386fc5 Apr 29 06:39:35 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:36 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d5d7f0a6-b53c-4b82-a7eb-940d54147319 tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.00201b51-654d-40e2-936a-0640b5386fc5" returned: 0 in 0.662s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d5d7f0a6-b53c-4b82-a7eb-940d54147319 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:36 devstack sudo[88164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.info Apr 29 06:39:36 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:36 devstack cinder-volume[84195]: DEBUG oslo_service.periodic_task [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84195) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 06:39:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:39:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:39:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:39:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:39:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.073s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:39:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:36 devstack sudo[88186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:39:36 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:37 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d5d7f0a6-b53c-4b82-a7eb-940d54147319 tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.info" returned: 0 in 1.180s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:37 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-d5d7f0a6-b53c-4b82-a7eb-940d54147319 tempest-VolumesDeleteCascade-1152844135 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.info is being set with open permissions: ugo+rw Apr 29 06:39:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d5d7f0a6-b53c-4b82-a7eb-940d54147319 tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:37 devstack sudo[88211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.info Apr 29 06:39:37 devstack sudo[88211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:37 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 1.236s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:37 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:39:38 devstack sudo[88211]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d5d7f0a6-b53c-4b82-a7eb-940d54147319 tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.info" returned: 0 in 1.194s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d5d7f0a6-b53c-4b82-a7eb-940d54147319 tempest-VolumesDeleteCascade-1152844135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.010s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:39:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.995s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:39:38 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1961985878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8c1eb88-14d6-4fda-bc3d-cad3f68fe482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6932aefddb49be84fb25f186a70c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:39:34Z,use_quota=True,user_id='ff8656b6dd9a41bb85b98e057e08ec25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:39:38 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Creating volume b8c1eb88-14d6-4fda-bc3d-cad3f68fe482 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:39:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:39:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:39:38 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:39:38 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:39:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:39:38 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:39:38 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:39:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b8c1eb88-14d6-4fda-bc3d-cad3f68fe482 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:38 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-d5d7f0a6-b53c-4b82-a7eb-940d54147319 tempest-VolumesDeleteCascade-1152844135 None] Create snapshot completed successfully Apr 29 06:39:38 devstack sudo[88246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b8c1eb88-14d6-4fda-bc3d-cad3f68fe482 1073741824 Apr 29 06:39:38 devstack sudo[88246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:40 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:39:40 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Flow 'volume_create_manager' (fbad692a-50e7-4780-92e4-ae2b251c9c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:39:40 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd1ae93-fd6b-448f-bb8b-8197d6bac247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd1ae93-fd6b-448f-bb8b-8197d6bac247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1985266630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a1a2432-6e2d-457f-aa1d-f24567aac39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35b89ae6589a4387bfb065d0bb3f45c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=00201b51-654d-40e2-936a-0640b5386fc5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:39:41Z,use_quota=True,user_id='9b308e89f10942f98c61536157d39df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67cfe0f3-f1e3-4781-b06b-1fd4843e626d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67cfe0f3-f1e3-4781-b06b-1fd4843e626d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15e939d-b422-4935-91df-cb55cba9cdae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15e939d-b422-4935-91df-cb55cba9cdae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0a1a2432-6e2d-457f-aa1d-f24567aac39b', 'volume_name': 'volume-0a1a2432-6e2d-457f-aa1d-f24567aac39b', 'volume_size': 1, 'snapshot_id': '00201b51-654d-40e2-936a-0640b5386fc5'}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8798f35-dcf0-4a84-80f4-93bb599ce79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8798f35-dcf0-4a84-80f4-93bb599ce79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af4e356-9822-4668-a837-29d6b79b0db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:41 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Volume 0a1a2432-6e2d-457f-aa1d-f24567aac39b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0a1a2432-6e2d-457f-aa1d-f24567aac39b', 'volume_size': 1, 'snapshot_id': '00201b51-654d-40e2-936a-0640b5386fc5'} Apr 29 06:39:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:39:41 devstack sudo[88246]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b8c1eb88-14d6-4fda-bc3d-cad3f68fe482 1073741824" returned: 0 in 2.471s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b8c1eb88-14d6-4fda-bc3d-cad3f68fe482 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:41 devstack sudo[88253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b8c1eb88-14d6-4fda-bc3d-cad3f68fe482 Apr 29 06:39:41 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:42 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b8c1eb88-14d6-4fda-bc3d-cad3f68fe482" returned: 0 in 1.232s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:42 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] <== create_volume: return (3759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:39:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.765s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:39:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.429s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:39:42 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "cinder-quobyte-00201b51-654d-40e2-936a-0640b5386fc5-0a1a2432-6e2d-457f-aa1d-f24567aac39b" by "_create_volume_from_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:39:42 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb63848-2a20-47f3-9fed-fbdc37d0359d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8c1eb88-14d6-4fda-bc3d-cad3f68fe482', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:42 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9860c348-c6d8-4f53-b4fc-93f6b9c4b79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:42 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-quobyte-00201b51-654d-40e2-936a-0640b5386fc5-0a1a2432-6e2d-457f-aa1d-f24567aac39b" acquired by "_create_volume_from_snapshot" :: waited 0.102s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:39:42 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Creating volume 0a1a2432-6e2d-457f-aa1d-f24567aac39b from snapshot 00201b51-654d-40e2-936a-0640b5386fc5 {{(pid=84195) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 06:39:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:39:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:39:42 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:39:42 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:39:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:39:42 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:39:42 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "cinder-quobyte-0a1a2432-6e2d-457f-aa1d-f24567aac39b" by "_copy_volume_from_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:39:42 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Volume volume-b8c1eb88-14d6-4fda-bc3d-cad3f68fe482 (b8c1eb88-14d6-4fda-bc3d-cad3f68fe482): created successfully Apr 29 06:39:42 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9860c348-c6d8-4f53-b4fc-93f6b9c4b79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:42 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Flow 'volume_create_manager' (0ca212a6-046a-4a35-a7ff-441b1316b893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:39:42 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-quobyte-0a1a2432-6e2d-457f-aa1d-f24567aac39b" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:39:42 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] snapshot: 00201b51-654d-40e2-936a-0640b5386fc5, volume: 0a1a2432-6e2d-457f-aa1d-f24567aac39b, {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 06:39:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:39:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:39:42 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:39:42 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:39:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:39:42 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-17daf6d1-ed80-4be5-a242-06ab83912ab6 tempest-VolumesActionsTest-1300197604 None] Created volume successfully. Apr 29 06:39:42 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a53304a-49ce-4765-b1a1-6fb455fda0d8]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:39:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.00201b51-654d-40e2-936a-0640b5386fc5 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:43 devstack sudo[88256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.00201b51-654d-40e2-936a-0640b5386fc5 Apr 29 06:39:43 devstack sudo[88256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:44 devstack sudo[88256]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.00201b51-654d-40e2-936a-0640b5386fc5" returned: 0 in 1.372s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f59a77c1-3128-4f52-be2d-561197d4bbb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:39:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8 {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 06:39:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Creating direct copy from snapshot {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 06:39:44 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeac333d-51c6-4248-8c4d-9a3245c92146]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:39:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:44 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f60aeb14-f347-4c77-8c81-672a1b60700f tempest-VolumesActionsTest-340776006 None] Acquiring lock "cinder-b8c1eb88-14d6-4fda-bc3d-cad3f68fe482-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:39:44 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f60aeb14-f347-4c77-8c81-672a1b60700f tempest-VolumesActionsTest-340776006 None] Lock "cinder-b8c1eb88-14d6-4fda-bc3d-cad3f68fe482-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:39:44 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f60aeb14-f347-4c77-8c81-672a1b60700f tempest-VolumesActionsTest-340776006 None] Acquiring lock "cinder-quobyte-b8c1eb88-14d6-4fda-bc3d-cad3f68fe482" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:39:44 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f60aeb14-f347-4c77-8c81-672a1b60700f tempest-VolumesActionsTest-340776006 None] Lock "cinder-quobyte-b8c1eb88-14d6-4fda-bc3d-cad3f68fe482" acquired by "delete_volume" :: waited 0.035s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:39:44 devstack sudo[88294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8 Apr 29 06:39:44 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:44 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6bae52-5384-4188-b776-35a390f34dd1]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:39:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f60aeb14-f347-4c77-8c81-672a1b60700f tempest-VolumesActionsTest-340776006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b8c1eb88-14d6-4fda-bc3d-cad3f68fe482 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:45 devstack sudo[88298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b8c1eb88-14d6-4fda-bc3d-cad3f68fe482 Apr 29 06:39:45 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:45 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8" returned: 0 in 1.701s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:46 devstack cinder-volume[84195]: DEBUG cinder.utils [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Path /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0a1a2432-6e2d-457f-aa1d-f24567aac39b not found in is_blk_device check {{(pid=84195) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 06:39:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0a1a2432-6e2d-457f-aa1d-f24567aac39b {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:46 devstack sudo[88369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0a1a2432-6e2d-457f-aa1d-f24567aac39b Apr 29 06:39:46 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:46 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f60aeb14-f347-4c77-8c81-672a1b60700f tempest-VolumesActionsTest-340776006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b8c1eb88-14d6-4fda-bc3d-cad3f68fe482" returned: 0 in 1.502s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f60aeb14-f347-4c77-8c81-672a1b60700f tempest-VolumesActionsTest-340776006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b8c1eb88-14d6-4fda-bc3d-cad3f68fe482 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:46 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b8c1eb88-14d6-4fda-bc3d-cad3f68fe482 Apr 29 06:39:46 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:47 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f60aeb14-f347-4c77-8c81-672a1b60700f tempest-VolumesActionsTest-340776006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b8c1eb88-14d6-4fda-bc3d-cad3f68fe482" returned: 0 in 1.015s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f60aeb14-f347-4c77-8c81-672a1b60700f tempest-VolumesActionsTest-340776006 None] Lock "cinder-quobyte-b8c1eb88-14d6-4fda-bc3d-cad3f68fe482" released by "delete_volume" :: held 2.596s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:39:47 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-f60aeb14-f347-4c77-8c81-672a1b60700f tempest-VolumesActionsTest-340776006 None] Created reservations ['20ebbf14-254a-48c6-b954-24244a64eb1e', '3faf2639-75ae-4cb2-bb10-3f4f21efa5a8', '4427b856-2185-44d0-adea-bd6260479ffa', '04376916-025d-4490-98b6-b191bd2402af'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:39:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f60aeb14-f347-4c77-8c81-672a1b60700f tempest-VolumesActionsTest-340776006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:39:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f60aeb14-f347-4c77-8c81-672a1b60700f tempest-VolumesActionsTest-340776006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:39:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f60aeb14-f347-4c77-8c81-672a1b60700f tempest-VolumesActionsTest-340776006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:39:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f60aeb14-f347-4c77-8c81-672a1b60700f tempest-VolumesActionsTest-340776006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:39:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f60aeb14-f347-4c77-8c81-672a1b60700f tempest-VolumesActionsTest-340776006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:39:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f60aeb14-f347-4c77-8c81-672a1b60700f tempest-VolumesActionsTest-340776006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:47 devstack sudo[88382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:39:47 devstack sudo[88382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-767134e7-e8c2-4045-82d0-dab3c27c4f03 tempest-ServerRescueNegativeTestJSON-521609512 None] Acquiring lock "cinder-dacca973-31cb-4ded-ac74-d4a4553f51c7-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:39:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-767134e7-e8c2-4045-82d0-dab3c27c4f03 tempest-ServerRescueNegativeTestJSON-521609512 None] Lock "cinder-dacca973-31cb-4ded-ac74-d4a4553f51c7-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:39:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-767134e7-e8c2-4045-82d0-dab3c27c4f03 tempest-ServerRescueNegativeTestJSON-521609512 None] Acquiring lock "cinder-quobyte-dacca973-31cb-4ded-ac74-d4a4553f51c7" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:39:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-767134e7-e8c2-4045-82d0-dab3c27c4f03 tempest-ServerRescueNegativeTestJSON-521609512 None] Lock "cinder-quobyte-dacca973-31cb-4ded-ac74-d4a4553f51c7" acquired by "delete_volume" :: waited 0.043s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:39:47 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd83db3-ec47-44cb-8764-4460c29a9d18]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:39:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-767134e7-e8c2-4045-82d0-dab3c27c4f03 tempest-ServerRescueNegativeTestJSON-521609512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-dacca973-31cb-4ded-ac74-d4a4553f51c7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:48 devstack sudo[88392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-dacca973-31cb-4ded-ac74-d4a4553f51c7 Apr 29 06:39:48 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:49 devstack sudo[88382]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f60aeb14-f347-4c77-8c81-672a1b60700f tempest-VolumesActionsTest-340776006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 2.408s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:49 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-f60aeb14-f347-4c77-8c81-672a1b60700f tempest-VolumesActionsTest-340776006 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:39:49 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-f60aeb14-f347-4c77-8c81-672a1b60700f tempest-VolumesActionsTest-340776006 None] Deleted volume successfully. Apr 29 06:39:49 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f60aeb14-f347-4c77-8c81-672a1b60700f tempest-VolumesActionsTest-340776006 None] Lock "cinder-b8c1eb88-14d6-4fda-bc3d-cad3f68fe482-delete_volume" released by "delete_volume" :: held 5.518s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:39:50 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:39:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Flow 'volume_create_manager' (3a5b4800-8885-431b-881a-876a1ff8ce8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:39:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35bc0b11-df59-405c-acb1-22395f7357ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35bc0b11-df59-405c-acb1-22395f7357ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1623962717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a0438e-233c-48c9-a0d4-677e64f34dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6932aefddb49be84fb25f186a70c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:39:50Z,use_quota=True,user_id='ff8656b6dd9a41bb85b98e057e08ec25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3eea3f2-8f6e-45d2-98a9-d688cbdefc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3eea3f2-8f6e-45d2-98a9-d688cbdefc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a4512ca-bc72-4905-9c68-4470177fb58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a4512ca-bc72-4905-9c68-4470177fb58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81a0438e-233c-48c9-a0d4-677e64f34dfa', 'volume_name': 'volume-81a0438e-233c-48c9-a0d4-677e64f34dfa', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c9a22f0-98ba-460d-8f4d-eaeec9eebe98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c9a22f0-98ba-460d-8f4d-eaeec9eebe98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00439656-5401-4abb-b63d-f89f2cf74997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:50 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Volume 81a0438e-233c-48c9-a0d4-677e64f34dfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81a0438e-233c-48c9-a0d4-677e64f34dfa', 'volume_size': 1} Apr 29 06:39:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:39:50 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-767134e7-e8c2-4045-82d0-dab3c27c4f03 tempest-ServerRescueNegativeTestJSON-521609512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-dacca973-31cb-4ded-ac74-d4a4553f51c7" returned: 0 in 3.079s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-767134e7-e8c2-4045-82d0-dab3c27c4f03 tempest-ServerRescueNegativeTestJSON-521609512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-dacca973-31cb-4ded-ac74-d4a4553f51c7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:51 devstack sudo[88403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-dacca973-31cb-4ded-ac74-d4a4553f51c7 Apr 29 06:39:51 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:53 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-767134e7-e8c2-4045-82d0-dab3c27c4f03 tempest-ServerRescueNegativeTestJSON-521609512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-dacca973-31cb-4ded-ac74-d4a4553f51c7" returned: 0 in 2.563s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:53 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-767134e7-e8c2-4045-82d0-dab3c27c4f03 tempest-ServerRescueNegativeTestJSON-521609512 None] Lock "cinder-quobyte-dacca973-31cb-4ded-ac74-d4a4553f51c7" released by "delete_volume" :: held 5.757s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:39:53 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-767134e7-e8c2-4045-82d0-dab3c27c4f03 tempest-ServerRescueNegativeTestJSON-521609512 None] Created reservations ['a44696f3-0064-40f8-9885-1c1d378f787a', '8b2bb5de-544b-4479-884a-2b60ca485340', '4328f603-115f-402b-acdb-5523dd73cc61', 'fd7541b7-2750-4db4-aa6c-19bd8d2db853'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:39:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-767134e7-e8c2-4045-82d0-dab3c27c4f03 tempest-ServerRescueNegativeTestJSON-521609512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:39:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-767134e7-e8c2-4045-82d0-dab3c27c4f03 tempest-ServerRescueNegativeTestJSON-521609512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:39:53 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-767134e7-e8c2-4045-82d0-dab3c27c4f03 tempest-ServerRescueNegativeTestJSON-521609512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:39:53 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-767134e7-e8c2-4045-82d0-dab3c27c4f03 tempest-ServerRescueNegativeTestJSON-521609512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:39:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-767134e7-e8c2-4045-82d0-dab3c27c4f03 tempest-ServerRescueNegativeTestJSON-521609512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:39:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-767134e7-e8c2-4045-82d0-dab3c27c4f03 tempest-ServerRescueNegativeTestJSON-521609512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:53 devstack sudo[88406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:39:53 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:56 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-767134e7-e8c2-4045-82d0-dab3c27c4f03 tempest-ServerRescueNegativeTestJSON-521609512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 2.686s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:56 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-767134e7-e8c2-4045-82d0-dab3c27c4f03 tempest-ServerRescueNegativeTestJSON-521609512 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:39:56 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-767134e7-e8c2-4045-82d0-dab3c27c4f03 tempest-ServerRescueNegativeTestJSON-521609512 None] Deleted volume successfully. Apr 29 06:39:56 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:56 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-767134e7-e8c2-4045-82d0-dab3c27c4f03 tempest-ServerRescueNegativeTestJSON-521609512 None] Lock "cinder-dacca973-31cb-4ded-ac74-d4a4553f51c7-delete_volume" released by "delete_volume" :: held 8.894s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:39:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0a1a2432-6e2d-457f-aa1d-f24567aac39b" returned: 0 in 10.562s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:56 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0272f46-eac3-455a-b6dd-5d60e7ec485e]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:39:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:56 devstack sudo[88442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8 Apr 29 06:39:56 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:58 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8" returned: 0 in 1.731s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:58 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Image conversion details: src /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8, size 1024.00 MB, duration 10.56 sec, destination /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0a1a2432-6e2d-457f-aa1d-f24567aac39b {{(pid=84195) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 06:39:58 devstack cinder-volume[84195]: INFO cinder.image.image_utils [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Converted 1024.00 MB image at 96.94 MB/s Apr 29 06:39:58 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0a1a2432-6e2d-457f-aa1d-f24567aac39b is being set with open permissions: ugo+rw Apr 29 06:39:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0a1a2432-6e2d-457f-aa1d-f24567aac39b {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:58 devstack sudo[88459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0a1a2432-6e2d-457f-aa1d-f24567aac39b Apr 29 06:39:58 devstack sudo[88459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:59 devstack sudo[88459]: pam_unix(sudo:session): session closed for user root Apr 29 06:39:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0a1a2432-6e2d-457f-aa1d-f24567aac39b" returned: 0 in 1.064s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:39:59 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-quobyte-0a1a2432-6e2d-457f-aa1d-f24567aac39b" released by "_copy_volume_from_snapshot" :: held 16.630s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:39:59 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-quobyte-00201b51-654d-40e2-936a-0640b5386fc5-0a1a2432-6e2d-457f-aa1d-f24567aac39b" released by "_create_volume_from_snapshot" :: held 16.704s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:39:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 16.809s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:39:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.480s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:39:59 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1623962717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a0438e-233c-48c9-a0d4-677e64f34dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6932aefddb49be84fb25f186a70c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:39:50Z,use_quota=True,user_id='ff8656b6dd9a41bb85b98e057e08ec25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:39:59 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Creating volume 81a0438e-233c-48c9-a0d4-677e64f34dfa {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:39:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:39:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:39:59 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:39:59 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:39:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:39:59 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:39:59 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:39:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-81a0438e-233c-48c9-a0d4-677e64f34dfa 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:39:59 devstack sudo[88464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-81a0438e-233c-48c9-a0d4-677e64f34dfa 1073741824 Apr 29 06:39:59 devstack sudo[88464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:39:59 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af4e356-9822-4668-a837-29d6b79b0db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a1a2432-6e2d-457f-aa1d-f24567aac39b', 'volume_size': 1, 'snapshot_id': '00201b51-654d-40e2-936a-0640b5386fc5'}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:59 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4284434-7df4-43b7-885c-382dd890f741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:59 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Volume volume-0a1a2432-6e2d-457f-aa1d-f24567aac39b (0a1a2432-6e2d-457f-aa1d-f24567aac39b): created successfully Apr 29 06:39:59 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4284434-7df4-43b7-885c-382dd890f741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:59 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Flow 'volume_create_manager' (fbad692a-50e7-4780-92e4-ae2b251c9c54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:39:59 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-9fae7a5f-6c3c-4fd4-87f1-e5ce106faa9f tempest-VolumesDeleteCascade-1152844135 None] Created volume successfully. Apr 29 06:39:59 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:39:59 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Flow 'volume_create_manager' (8f813dc3-2451-4593-9de7-e1b49d1a28e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:39:59 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6db0ee22-2c1c-4503-8264-fbe291e48f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:59 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6db0ee22-2c1c-4503-8264-fbe291e48f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:39:59Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee391713-eeda-422e-abce-8ea949e66356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9754cd3eaea84f7bbf4fb98f6e306b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:40:00Z,use_quota=True,user_id='f7e85e53c25343b688bcd0c191bf4ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:59 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (302391e8-5310-4373-87fc-ed43d101e2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:59 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (302391e8-5310-4373-87fc-ed43d101e2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:39:59 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74db8536-6c13-40fd-b571-8c83fba9575b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:39:59 devstack cinder-volume[84195]: DEBUG cinder.image.glance [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Creating Keystone auth plugin from conf {{(pid=84195) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 06:40:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "cinder-f59a77c1-3128-4f52-be2d-561197d4bbb8-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-f59a77c1-3128-4f52-be2d-561197d4bbb8-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:00 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Performing cascade delete. {{(pid=84195) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 29 06:40:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "cinder-00201b51-654d-40e2-936a-0640b5386fc5-delete_snapshot" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-00201b51-654d-40e2-936a-0640b5386fc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "cinder-quobyte-f59a77c1-3128-4f52-be2d-561197d4bbb8" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-quobyte-f59a77c1-3128-4f52-be2d-561197d4bbb8" acquired by "delete_snapshot" :: waited 0.034s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "cinder-quobyte-00201b51-654d-40e2-936a-0640b5386fc5" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-quobyte-00201b51-654d-40e2-936a-0640b5386fc5" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:00 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Deleting offline snapshot 00201b51-654d-40e2-936a-0640b5386fc5 of volume f59a77c1-3128-4f52-be2d-561197d4bbb8 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:40:00 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] snapshot_file for this snap is: volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.00201b51-654d-40e2-936a-0640b5386fc5 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:40:00 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcf9c92-bedc-4eae-b9b5-6e93530b2dba]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.00201b51-654d-40e2-936a-0640b5386fc5 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:00 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74db8536-6c13-40fd-b571-8c83fba9575b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ee391713-eeda-422e-abce-8ea949e66356', 'volume_name': 'volume-ee391713-eeda-422e-abce-8ea949e66356', 'volume_size': 1, 'image_id': '3c917343-78b7-403b-853d-4aeabac3edf1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c917343-78b7-403b-853d-4aeabac3edf1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0b2d77ae633e436aa18dac7e4fad942b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c917343-78b7-403b-853d-4aeabac3edf1', 'created_at': datetime.datetime(2026, 4, 29, 4, 32, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 4, 32, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c917343-78b7-403b-853d-4aeabac3edf1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:00 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e26a124-9a58-439c-9b54-80c3f2bf215e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:00 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e26a124-9a58-439c-9b54-80c3f2bf215e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:00 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc0bc155-ed9e-44cf-aedb-98bcba21a876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:00 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Volume ee391713-eeda-422e-abce-8ea949e66356: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ee391713-eeda-422e-abce-8ea949e66356', 'volume_size': 1, 'image_id': '3c917343-78b7-403b-853d-4aeabac3edf1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c917343-78b7-403b-853d-4aeabac3edf1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0b2d77ae633e436aa18dac7e4fad942b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c917343-78b7-403b-853d-4aeabac3edf1', 'created_at': datetime.datetime(2026, 4, 29, 4, 32, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 4, 32, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c917343-78b7-403b-853d-4aeabac3edf1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 06:40:00 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Trying to clone ee391713-eeda-422e-abce-8ea949e66356 from image 3c917343-78b7-403b-853d-4aeabac3edf1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3c917343-78b7-403b-853d-4aeabac3edf1', 'metadata': {}}]). {{(pid=84195) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 29 06:40:00 devstack sudo[88472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.00201b51-654d-40e2-936a-0640b5386fc5 Apr 29 06:40:00 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:00 devstack sudo[88464]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-81a0438e-233c-48c9-a0d4-677e64f34dfa 1073741824" returned: 0 in 1.341s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-81a0438e-233c-48c9-a0d4-677e64f34dfa {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:00 devstack sudo[88476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-81a0438e-233c-48c9-a0d4-677e64f34dfa Apr 29 06:40:00 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:01 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_9n21_gkddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84195) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 06:40:01 devstack cinder-volume[84195]: INFO cinder.image.image_utils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Image download 20.69 MB at 20.69 MB/s Apr 29 06:40:01 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[68beac40-9682-490b-acf9-784b04825c1c]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_9n21_gkddevstack@QuobyteHD {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:01 devstack sudo[88499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_9n21_gkddevstack@QuobyteHD Apr 29 06:40:01 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:01 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.00201b51-654d-40e2-936a-0640b5386fc5" returned: 0 in 0.930s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:01 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f59a77c1-3128-4f52-be2d-561197d4bbb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:40:01 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[7299e34c-27c1-4c20-9fff-1811c120508d]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:01 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-81a0438e-233c-48c9-a0d4-677e64f34dfa" returned: 0 in 0.778s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:01 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] <== create_volume: return (2205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:40:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.209s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:01 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00439656-5401-4abb-b63d-f89f2cf74997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81a0438e-233c-48c9-a0d4-677e64f34dfa', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:01 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (483a9239-ea6c-448f-af94-20eda2cb73f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:01 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Volume volume-81a0438e-233c-48c9-a0d4-677e64f34dfa (81a0438e-233c-48c9-a0d4-677e64f34dfa): created successfully Apr 29 06:40:01 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (483a9239-ea6c-448f-af94-20eda2cb73f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:01 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Flow 'volume_create_manager' (3a5b4800-8885-431b-881a-876a1ff8ce8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:40:01 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-307ad26d-c444-4a58-a347-0ff7d88a6efd tempest-VolumesActionsTest-1300197604 None] Created volume successfully. Apr 29 06:40:01 devstack sudo[88507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8 Apr 29 06:40:01 devstack sudo[88507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:02 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_9n21_gkddevstack@QuobyteHD" returned: 0 in 0.870s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:02 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Temporary image 3c917343-78b7-403b-853d-4aeabac3edf1 is fetched for user f7e85e53c25343b688bcd0c191bf4ab3. {{(pid=84195) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 06:40:02 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[3991569c-6ff3-4324-902d-5c8853b4b4fd]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_9n21_gkddevstack@QuobyteHD {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:02 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-afb3bc02-586b-4d0d-9f63-a18446d07b34 tempest-VolumesActionsTest-340776006 None] Acquiring lock "cinder-81a0438e-233c-48c9-a0d4-677e64f34dfa-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:02 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-afb3bc02-586b-4d0d-9f63-a18446d07b34 tempest-VolumesActionsTest-340776006 None] Lock "cinder-81a0438e-233c-48c9-a0d4-677e64f34dfa-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:02 devstack sudo[88512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_9n21_gkddevstack@QuobyteHD Apr 29 06:40:02 devstack sudo[88512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:02 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-afb3bc02-586b-4d0d-9f63-a18446d07b34 tempest-VolumesActionsTest-340776006 None] Acquiring lock "cinder-quobyte-81a0438e-233c-48c9-a0d4-677e64f34dfa" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:02 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-afb3bc02-586b-4d0d-9f63-a18446d07b34 tempest-VolumesActionsTest-340776006 None] Lock "cinder-quobyte-81a0438e-233c-48c9-a0d4-677e64f34dfa" acquired by "delete_volume" :: waited 0.015s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:02 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd9239b-8cb1-479d-a1ca-109f46eb092f]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-afb3bc02-586b-4d0d-9f63-a18446d07b34 tempest-VolumesActionsTest-340776006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-81a0438e-233c-48c9-a0d4-677e64f34dfa {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:02 devstack sudo[88517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-81a0438e-233c-48c9-a0d4-677e64f34dfa Apr 29 06:40:02 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:02 devstack sudo[88507]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8" returned: 0 in 0.903s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.00201b51-654d-40e2-936a-0640b5386fc5 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:02 devstack sudo[88519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.00201b51-654d-40e2-936a-0640b5386fc5 Apr 29 06:40:02 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:02 devstack sudo[88512]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_9n21_gkddevstack@QuobyteHD" returned: 0 in 0.799s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:02 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:39:59Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee391713-eeda-422e-abce-8ea949e66356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9754cd3eaea84f7bbf4fb98f6e306b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:40:00Z,use_quota=True,user_id='f7e85e53c25343b688bcd0c191bf4ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:40:02 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Creating volume ee391713-eeda-422e-abce-8ea949e66356 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:40:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:02 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:40:03 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:40:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:03 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:40:03 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:40:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:03 devstack sudo[88524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356 1073741824 Apr 29 06:40:03 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:03 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-afb3bc02-586b-4d0d-9f63-a18446d07b34 tempest-VolumesActionsTest-340776006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-81a0438e-233c-48c9-a0d4-677e64f34dfa" returned: 0 in 0.940s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-afb3bc02-586b-4d0d-9f63-a18446d07b34 tempest-VolumesActionsTest-340776006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-81a0438e-233c-48c9-a0d4-677e64f34dfa {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:03 devstack sudo[88535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-81a0438e-233c-48c9-a0d4-677e64f34dfa Apr 29 06:40:03 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:03 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.00201b51-654d-40e2-936a-0640b5386fc5" returned: 0 in 0.996s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.00201b51-654d-40e2-936a-0640b5386fc5 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:03 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.00201b51-654d-40e2-936a-0640b5386fc5 Apr 29 06:40:03 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:04 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-afb3bc02-586b-4d0d-9f63-a18446d07b34 tempest-VolumesActionsTest-340776006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-81a0438e-233c-48c9-a0d4-677e64f34dfa" returned: 0 in 0.707s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:04 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356 1073741824" returned: 0 in 1.034s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:04 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-afb3bc02-586b-4d0d-9f63-a18446d07b34 tempest-VolumesActionsTest-340776006 None] Lock "cinder-quobyte-81a0438e-233c-48c9-a0d4-677e64f34dfa" released by "delete_volume" :: held 1.701s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:04 devstack sudo[88544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356 Apr 29 06:40:04 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:04 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-afb3bc02-586b-4d0d-9f63-a18446d07b34 tempest-VolumesActionsTest-340776006 None] Created reservations ['a3930fa3-ef53-4726-91a5-7f8926810d80', 'a654ad43-ee3c-43d0-a13a-b92a704a6a3d', 'f266a56e-9cb3-4676-9e3a-b90c862f30d0', 'b06f640f-f8b6-4177-b579-2215d46350c2'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:40:04 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8.00201b51-654d-40e2-936a-0640b5386fc5" returned: 0 in 0.629s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:04 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-quobyte-00201b51-654d-40e2-936a-0640b5386fc5" released by "_delete_snapshot" :: held 3.597s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:04 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-quobyte-f59a77c1-3128-4f52-be2d-561197d4bbb8" released by "delete_snapshot" :: held 3.646s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-afb3bc02-586b-4d0d-9f63-a18446d07b34 tempest-VolumesActionsTest-340776006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-afb3bc02-586b-4d0d-9f63-a18446d07b34 tempest-VolumesActionsTest-340776006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-afb3bc02-586b-4d0d-9f63-a18446d07b34 tempest-VolumesActionsTest-340776006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:40:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-afb3bc02-586b-4d0d-9f63-a18446d07b34 tempest-VolumesActionsTest-340776006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:40:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-afb3bc02-586b-4d0d-9f63-a18446d07b34 tempest-VolumesActionsTest-340776006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-afb3bc02-586b-4d0d-9f63-a18446d07b34 tempest-VolumesActionsTest-340776006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:04 devstack sudo[88546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:40:04 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:04 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Created reservations ['b65b3fae-a012-4cb1-8fd9-d0aedc250449', '7a060cef-a57b-4d32-aae6-5d511bef464c', '2e80cf5b-ebe7-4462-ab5d-cdd9147242ff', '191a4a9d-75ca-4187-b059-3644cdda4e3e'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:40:04 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Delete snapshot completed successfully. Apr 29 06:40:04 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-00201b51-654d-40e2-936a-0640b5386fc5-delete_snapshot" released by "delete_snapshot" :: held 4.048s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Snapshots deleted, issuing volume delete {{(pid=84195) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 29 06:40:04 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "cinder-quobyte-f59a77c1-3128-4f52-be2d-561197d4bbb8" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:04 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-quobyte-f59a77c1-3128-4f52-be2d-561197d4bbb8" acquired by "delete_volume" :: waited 0.032s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:04 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4d7479-76e6-41fe-ad61-cc6be5967d8b]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:04 devstack sudo[88586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8 Apr 29 06:40:04 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:05 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356" returned: 0 in 0.940s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] <== create_volume: return (2035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.041s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG cinder.volume.volume_utils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Attempting download of 3c917343-78b7-403b-853d-4aeabac3edf1 ((None, [{'url': 'file:///opt/stack/data/glance/images/3c917343-78b7-403b-853d-4aeabac3edf1', 'metadata': {}}])) to volume ee391713-eeda-422e-abce-8ea949e66356. {{(pid=84195) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[965980fa-d25f-478e-a20f-64a2711991f4]: (4, 'raw') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c917343-78b7-403b-853d-4aeabac3edf1_fl9a27hz {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:05 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c917343-78b7-403b-853d-4aeabac3edf1_fl9a27hz Apr 29 06:40:05 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:40:05 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Flow 'volume_create_manager' (abbae0e0-0db6-4d6e-8d4c-7ff0ba64a58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e82485b-3fd9-4e23-b44f-bee3efc76976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-afb3bc02-586b-4d0d-9f63-a18446d07b34 tempest-VolumesActionsTest-340776006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 1.333s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-afb3bc02-586b-4d0d-9f63-a18446d07b34 tempest-VolumesActionsTest-340776006 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e82485b-3fd9-4e23-b44f-bee3efc76976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1096926261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a0fa530-2001-4245-a465-a20a3819ceed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6932aefddb49be84fb25f186a70c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:40:05Z,use_quota=True,user_id='ff8656b6dd9a41bb85b98e057e08ec25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87331a93-3748-4638-9c44-fa120f722b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87331a93-3748-4638-9c44-fa120f722b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df22073-f0d1-4ccf-8b28-0d610a63ea2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df22073-f0d1-4ccf-8b28-0d610a63ea2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a0fa530-2001-4245-a465-a20a3819ceed', 'volume_name': 'volume-0a0fa530-2001-4245-a465-a20a3819ceed', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0801bb28-f27a-41bf-b41f-7e39a746bf8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0801bb28-f27a-41bf-b41f-7e39a746bf8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7d4e91-bc09-432b-9e0f-4b9c46e9dd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:05 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Volume 0a0fa530-2001-4245-a465-a20a3819ceed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a0fa530-2001-4245-a465-a20a3819ceed', 'volume_size': 1} Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1096926261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a0fa530-2001-4245-a465-a20a3819ceed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6932aefddb49be84fb25f186a70c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:40:05Z,use_quota=True,user_id='ff8656b6dd9a41bb85b98e057e08ec25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Creating volume 0a0fa530-2001-4245-a465-a20a3819ceed {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:40:05 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0a0fa530-2001-4245-a465-a20a3819ceed 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:05 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-afb3bc02-586b-4d0d-9f63-a18446d07b34 tempest-VolumesActionsTest-340776006 None] Deleted volume successfully. Apr 29 06:40:05 devstack sudo[88596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0a0fa530-2001-4245-a465-a20a3819ceed 1073741824 Apr 29 06:40:05 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:05 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-afb3bc02-586b-4d0d-9f63-a18446d07b34 tempest-VolumesActionsTest-340776006 None] Lock "cinder-81a0438e-233c-48c9-a0d4-677e64f34dfa-delete_volume" released by "delete_volume" :: held 3.449s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:06 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8" returned: 0 in 1.373s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:06 devstack sudo[88603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8 Apr 29 06:40:06 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:06 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c917343-78b7-403b-853d-4aeabac3edf1_fl9a27hz" returned: 0 in 0.987s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c917343-78b7-403b-853d-4aeabac3edf1_fl9a27hz {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:06 devstack sudo[88606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c917343-78b7-403b-853d-4aeabac3edf1_fl9a27hz Apr 29 06:40:06 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:06 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0a0fa530-2001-4245-a465-a20a3819ceed 1073741824" returned: 0 in 1.133s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:06 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f59a77c1-3128-4f52-be2d-561197d4bbb8" returned: 0 in 0.848s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:06 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-quobyte-f59a77c1-3128-4f52-be2d-561197d4bbb8" released by "delete_volume" :: held 2.383s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0a0fa530-2001-4245-a465-a20a3819ceed {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:07 devstack sudo[88617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0a0fa530-2001-4245-a465-a20a3819ceed Apr 29 06:40:07 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:07 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c917343-78b7-403b-853d-4aeabac3edf1_fl9a27hz" returned: 1 in 0.888s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c917343-78b7-403b-853d-4aeabac3edf1_fl9a27hz' failed. Not Retrying. {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 06:40:07 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb467946-d5d7-4adf-ab2f-ed39c6e59741]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_9n21_gkddevstack@QuobyteHD {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:07 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Created reservations ['98a7863a-d5b7-485e-bb45-a92b416196e8', '6648061b-22bc-41d2-a19e-bd53f897fa57', '76b19537-fe92-4de7-a7cc-2e9e6378b36c', '33f5f623-cbc7-4953-b522-310c4db07bf7'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:40:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:07 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:40:07 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:40:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:07 devstack sudo[88619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_9n21_gkddevstack@QuobyteHD Apr 29 06:40:07 devstack sudo[88619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:07 devstack sudo[88620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:40:07 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:07 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0a0fa530-2001-4245-a465-a20a3819ceed" returned: 0 in 0.708s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:07 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] <== create_volume: return (2107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:40:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.114s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:07 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7d4e91-bc09-432b-9e0f-4b9c46e9dd13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a0fa530-2001-4245-a465-a20a3819ceed', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:07 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c09ecf-6d09-4f47-b6f0-4d8c520c3b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:07 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Volume volume-0a0fa530-2001-4245-a465-a20a3819ceed (0a0fa530-2001-4245-a465-a20a3819ceed): created successfully Apr 29 06:40:07 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:07 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c09ecf-6d09-4f47-b6f0-4d8c520c3b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:07 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Flow 'volume_create_manager' (abbae0e0-0db6-4d6e-8d4c-7ff0ba64a58b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:40:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.649s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:07 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:40:07 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Deleted volume successfully. Apr 29 06:40:07 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-d02d0e32-9843-4d8c-9381-80e8971e9682 tempest-VolumesActionsTest-1300197604 None] Created volume successfully. Apr 29 06:40:07 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-12961a3a-fe17-45cd-bb92-4d6aaf05724d tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-f59a77c1-3128-4f52-be2d-561197d4bbb8-delete_volume" released by "delete_volume" :: held 7.471s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:07 devstack sudo[88619]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_9n21_gkddevstack@QuobyteHD" returned: 0 in 0.842s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:07 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] 3c917343-78b7-403b-853d-4aeabac3edf1 was qcow2, converting to raw {{(pid=84195) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 06:40:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_9n21_gkddevstack@QuobyteHD /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:07 devstack sudo[88629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_9n21_gkddevstack@QuobyteHD /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356 Apr 29 06:40:07 devstack sudo[88629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:08 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-513c4e2e-44d9-4dfe-8f14-ebbe92bb0b2e tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "cinder-0a1a2432-6e2d-457f-aa1d-f24567aac39b-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:08 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-513c4e2e-44d9-4dfe-8f14-ebbe92bb0b2e tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-0a1a2432-6e2d-457f-aa1d-f24567aac39b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:08 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-513c4e2e-44d9-4dfe-8f14-ebbe92bb0b2e tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "cinder-quobyte-0a1a2432-6e2d-457f-aa1d-f24567aac39b" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:08 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-513c4e2e-44d9-4dfe-8f14-ebbe92bb0b2e tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-quobyte-0a1a2432-6e2d-457f-aa1d-f24567aac39b" acquired by "delete_volume" :: waited 0.018s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:08 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a7cf4f-da5d-43f0-94fb-50252af1d4d2]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-513c4e2e-44d9-4dfe-8f14-ebbe92bb0b2e tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0a1a2432-6e2d-457f-aa1d-f24567aac39b {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:08 devstack sudo[88631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0a1a2432-6e2d-457f-aa1d-f24567aac39b Apr 29 06:40:08 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:09 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-513c4e2e-44d9-4dfe-8f14-ebbe92bb0b2e tempest-VolumesDeleteCascade-1152844135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0a1a2432-6e2d-457f-aa1d-f24567aac39b" returned: 0 in 0.847s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-513c4e2e-44d9-4dfe-8f14-ebbe92bb0b2e tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0a1a2432-6e2d-457f-aa1d-f24567aac39b {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:09 devstack sudo[88644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0a1a2432-6e2d-457f-aa1d-f24567aac39b Apr 29 06:40:09 devstack sudo[88644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:09 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3d08957b-af1a-45d2-bb52-b262a47fbd12 tempest-VolumesActionsTest-1300197604 None] Acquiring lock "cinder-0a0fa530-2001-4245-a465-a20a3819ceed-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:09 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3d08957b-af1a-45d2-bb52-b262a47fbd12 tempest-VolumesActionsTest-1300197604 None] Lock "cinder-0a0fa530-2001-4245-a465-a20a3819ceed-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:09 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3d08957b-af1a-45d2-bb52-b262a47fbd12 tempest-VolumesActionsTest-1300197604 None] Acquiring lock "cinder-quobyte-0a0fa530-2001-4245-a465-a20a3819ceed" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:09 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3d08957b-af1a-45d2-bb52-b262a47fbd12 tempest-VolumesActionsTest-1300197604 None] Lock "cinder-quobyte-0a0fa530-2001-4245-a465-a20a3819ceed" acquired by "delete_volume" :: waited 0.032s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:09 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[f787667a-ce86-4423-a663-684fb67f4507]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3d08957b-af1a-45d2-bb52-b262a47fbd12 tempest-VolumesActionsTest-1300197604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0a0fa530-2001-4245-a465-a20a3819ceed {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:09 devstack sudo[88646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0a0fa530-2001-4245-a465-a20a3819ceed Apr 29 06:40:09 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:10 devstack sudo[88644]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-513c4e2e-44d9-4dfe-8f14-ebbe92bb0b2e tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0a1a2432-6e2d-457f-aa1d-f24567aac39b" returned: 0 in 0.727s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:10 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-513c4e2e-44d9-4dfe-8f14-ebbe92bb0b2e tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-quobyte-0a1a2432-6e2d-457f-aa1d-f24567aac39b" released by "delete_volume" :: held 1.622s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:10 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-513c4e2e-44d9-4dfe-8f14-ebbe92bb0b2e tempest-VolumesDeleteCascade-1152844135 None] Created reservations ['754b2fbb-ca62-4b33-8864-0a5fc936ffe0', 'e5d0443e-a6d7-40d0-b2cf-cef1381962ee', 'eebbbdae-ced1-4f01-b592-6a6addfb1d4e', '5154f1d8-2551-4a07-aecc-2cfd37e5b3f3'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:40:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-513c4e2e-44d9-4dfe-8f14-ebbe92bb0b2e tempest-VolumesDeleteCascade-1152844135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-513c4e2e-44d9-4dfe-8f14-ebbe92bb0b2e tempest-VolumesDeleteCascade-1152844135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:10 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-513c4e2e-44d9-4dfe-8f14-ebbe92bb0b2e tempest-VolumesDeleteCascade-1152844135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:40:10 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-513c4e2e-44d9-4dfe-8f14-ebbe92bb0b2e tempest-VolumesDeleteCascade-1152844135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:40:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-513c4e2e-44d9-4dfe-8f14-ebbe92bb0b2e tempest-VolumesDeleteCascade-1152844135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-513c4e2e-44d9-4dfe-8f14-ebbe92bb0b2e tempest-VolumesDeleteCascade-1152844135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:10 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:40:10 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:10 devstack sudo[88629]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_9n21_gkddevstack@QuobyteHD /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356" returned: 0 in 2.767s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:10 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_9n21_gkddevstack@QuobyteHD, size 112.00 MB, duration 2.77 sec, destination /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356 {{(pid=84195) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 06:40:10 devstack cinder-volume[84195]: INFO cinder.image.image_utils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Converted 112.00 MB image at 40.45 MB/s Apr 29 06:40:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:10 devstack sudo[88651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356 1G Apr 29 06:40:10 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:11 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3d08957b-af1a-45d2-bb52-b262a47fbd12 tempest-VolumesActionsTest-1300197604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0a0fa530-2001-4245-a465-a20a3819ceed" returned: 0 in 1.459s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3d08957b-af1a-45d2-bb52-b262a47fbd12 tempest-VolumesActionsTest-1300197604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0a0fa530-2001-4245-a465-a20a3819ceed {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:11 devstack sudo[88656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0a0fa530-2001-4245-a465-a20a3819ceed Apr 29 06:40:11 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:11 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-513c4e2e-44d9-4dfe-8f14-ebbe92bb0b2e tempest-VolumesDeleteCascade-1152844135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 1.383s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:11 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-513c4e2e-44d9-4dfe-8f14-ebbe92bb0b2e tempest-VolumesDeleteCascade-1152844135 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:40:11 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-513c4e2e-44d9-4dfe-8f14-ebbe92bb0b2e tempest-VolumesDeleteCascade-1152844135 None] Deleted volume successfully. Apr 29 06:40:11 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-513c4e2e-44d9-4dfe-8f14-ebbe92bb0b2e tempest-VolumesDeleteCascade-1152844135 None] Lock "cinder-0a1a2432-6e2d-457f-aa1d-f24567aac39b-delete_volume" released by "delete_volume" :: held 3.318s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:11 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356 1G" returned: 0 in 1.239s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:12 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d695722-221b-4f00-98a7-0683e267535e]: (4, 'raw') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:12 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356 Apr 29 06:40:12 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:12 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3d08957b-af1a-45d2-bb52-b262a47fbd12 tempest-VolumesActionsTest-1300197604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0a0fa530-2001-4245-a465-a20a3819ceed" returned: 0 in 1.021s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:12 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3d08957b-af1a-45d2-bb52-b262a47fbd12 tempest-VolumesActionsTest-1300197604 None] Lock "cinder-quobyte-0a0fa530-2001-4245-a465-a20a3819ceed" released by "delete_volume" :: held 2.567s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:12 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-3d08957b-af1a-45d2-bb52-b262a47fbd12 tempest-VolumesActionsTest-1300197604 None] Created reservations ['b403f09f-5f03-4bd6-9e48-843405ce6efc', '80e4db26-bd30-4064-b8b1-1f19c50ed68f', 'b2a93768-627e-4722-beff-e5acd9b4519a', '2a9c3f5a-f55b-47a5-a591-9d387e2cea4a'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:40:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3d08957b-af1a-45d2-bb52-b262a47fbd12 tempest-VolumesActionsTest-1300197604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3d08957b-af1a-45d2-bb52-b262a47fbd12 tempest-VolumesActionsTest-1300197604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:12 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-3d08957b-af1a-45d2-bb52-b262a47fbd12 tempest-VolumesActionsTest-1300197604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:40:12 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-3d08957b-af1a-45d2-bb52-b262a47fbd12 tempest-VolumesActionsTest-1300197604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:40:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3d08957b-af1a-45d2-bb52-b262a47fbd12 tempest-VolumesActionsTest-1300197604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3d08957b-af1a-45d2-bb52-b262a47fbd12 tempest-VolumesActionsTest-1300197604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:12 devstack sudo[88666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:40:12 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:13 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356" returned: 0 in 1.152s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:13 devstack sudo[88670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356 Apr 29 06:40:13 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:13 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3d08957b-af1a-45d2-bb52-b262a47fbd12 tempest-VolumesActionsTest-1300197604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 1.272s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:13 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-3d08957b-af1a-45d2-bb52-b262a47fbd12 tempest-VolumesActionsTest-1300197604 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:40:13 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-3d08957b-af1a-45d2-bb52-b262a47fbd12 tempest-VolumesActionsTest-1300197604 None] Deleted volume successfully. Apr 29 06:40:13 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3d08957b-af1a-45d2-bb52-b262a47fbd12 tempest-VolumesActionsTest-1300197604 None] Lock "cinder-0a0fa530-2001-4245-a465-a20a3819ceed-delete_volume" released by "delete_volume" :: held 4.218s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:14 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356" returned: 1 in 1.039s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356' failed. Not Retrying. {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 06:40:14 devstack cinder-volume[84195]: DEBUG cinder.volume.volume_utils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Downloaded image 3c917343-78b7-403b-853d-4aeabac3edf1 ((None, [{'url': 'file:///opt/stack/data/glance/images/3c917343-78b7-403b-853d-4aeabac3edf1', 'metadata': {}}])) to volume ee391713-eeda-422e-abce-8ea949e66356 successfully. {{(pid=84195) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 06:40:14 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Temporary image 3c917343-78b7-403b-853d-4aeabac3edf1 for user f7e85e53c25343b688bcd0c191bf4ab3 is deleted. {{(pid=84195) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 06:40:14 devstack cinder-volume[84195]: DEBUG cinder.volume.volume_utils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Marking volume ee391713-eeda-422e-abce-8ea949e66356 as bootable. {{(pid=84195) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 06:40:14 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:SELECT=87,cinder:INSERT=31,cinder:UPDATE=124,cinder:DELETE=6 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:40:14 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Copying metadata from image 3c917343-78b7-403b-853d-4aeabac3edf1 to ee391713-eeda-422e-abce-8ea949e66356. {{(pid=84195) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 06:40:14 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Creating volume glance metadata for volume ee391713-eeda-422e-abce-8ea949e66356 backed by image 3c917343-78b7-403b-853d-4aeabac3edf1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3c917343-78b7-403b-853d-4aeabac3edf1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84195) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 06:40:14 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc0bc155-ed9e-44cf-aedb-98bcba21a876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee391713-eeda-422e-abce-8ea949e66356', 'volume_size': 1, 'image_id': '3c917343-78b7-403b-853d-4aeabac3edf1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c917343-78b7-403b-853d-4aeabac3edf1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0b2d77ae633e436aa18dac7e4fad942b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c917343-78b7-403b-853d-4aeabac3edf1', 'created_at': datetime.datetime(2026, 4, 29, 4, 32, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 4, 32, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c917343-78b7-403b-853d-4aeabac3edf1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:14 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948ee5f9-0241-44dd-a0c9-9360dbe354ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:14 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Volume volume-ee391713-eeda-422e-abce-8ea949e66356 (ee391713-eeda-422e-abce-8ea949e66356): created successfully Apr 29 06:40:14 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948ee5f9-0241-44dd-a0c9-9360dbe354ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:14 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Flow 'volume_create_manager' (8f813dc3-2451-4593-9de7-e1b49d1a28e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:40:14 devstack cinder-volume[84195]: INFO cinder.volume.manager [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-29f385ed-88e3-4082-97ad-656a616d121b tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Created volume successfully. Apr 29 06:40:15 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:SELECT=88,cinder:INSERT=32,cinder:UPDATE=109,cinder:DELETE=13 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:40:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-5c26ca29-a56d-40ad-b137-3aaa3ca921f0 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-5c26ca29-a56d-40ad-b137-3aaa3ca921f0 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:15 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:40:15 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Flow 'volume_create_manager' (4d1219e8-ee5c-4c60-a216-615cbdfaf02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:40:15 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebcd1d5a-62b3-4728-907d-6a0fef4e2feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:15 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e93bf5-da5a-4dd5-af85-105fd2ce6567]: (4, 'raw') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-5c26ca29-a56d-40ad-b137-3aaa3ca921f0 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:15 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebcd1d5a-62b3-4728-907d-6a0fef4e2feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-9661026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038f7e6e-1806-478d-bafc-a1c331574adf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='796b8f119532409d9eb663d405652970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:40:16Z,use_quota=True,user_id='7133945d3591445f81385eee62f0678c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:15 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25533d1-c5c3-4917-ab5c-949e6b090bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:15 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25533d1-c5c3-4917-ab5c-949e6b090bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:15 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7db5f98-b9a8-4f86-a851-955fc9403633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:15 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7db5f98-b9a8-4f86-a851-955fc9403633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '038f7e6e-1806-478d-bafc-a1c331574adf', 'volume_name': 'volume-038f7e6e-1806-478d-bafc-a1c331574adf', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:15 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21e10ea-1e51-4730-85b3-17e235fc9d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:15 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21e10ea-1e51-4730-85b3-17e235fc9d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:15 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23488ba4-32d6-4989-aa35-a572c3dbb72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:15 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Volume 038f7e6e-1806-478d-bafc-a1c331574adf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-038f7e6e-1806-478d-bafc-a1c331574adf', 'volume_size': 1} Apr 29 06:40:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:15 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356 Apr 29 06:40:15 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:17 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-5c26ca29-a56d-40ad-b137-3aaa3ca921f0 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356" returned: 0 in 1.185s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-5c26ca29-a56d-40ad-b137-3aaa3ca921f0 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:17 devstack sudo[88692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356 Apr 29 06:40:17 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:17 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-5c26ca29-a56d-40ad-b137-3aaa3ca921f0 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356" returned: 1 in 0.965s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-5c26ca29-a56d-40ad-b137-3aaa3ca921f0 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356' failed. Not Retrying. {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 06:40:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-5c26ca29-a56d-40ad-b137-3aaa3ca921f0 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.234s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.098s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-9661026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038f7e6e-1806-478d-bafc-a1c331574adf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='796b8f119532409d9eb663d405652970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:40:16Z,use_quota=True,user_id='7133945d3591445f81385eee62f0678c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:40:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Creating volume 038f7e6e-1806-478d-bafc-a1c331574adf {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:40:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:40:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:40:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:40:18 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:40:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-038f7e6e-1806-478d-bafc-a1c331574adf 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:18 devstack sudo[88705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-038f7e6e-1806-478d-bafc-a1c331574adf 1073741824 Apr 29 06:40:18 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-5c26ca29-a56d-40ad-b137-3aaa3ca921f0 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9', 'name': 'volume-ee391713-eeda-422e-abce-8ea949e66356', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ae2f959-b1d6-41b4-8158-314008118d77', 'enforce_multipath': True} {{(pid=84195) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 06:40:18 devstack cinder-volume[84195]: INFO cinder.volume.manager [req-1e6c31ca-d95e-4de4-b425-1e71614b50f1 req-5c26ca29-a56d-40ad-b137-3aaa3ca921f0 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] attachment_update completed successfully. Apr 29 06:40:19 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-038f7e6e-1806-478d-bafc-a1c331574adf 1073741824" returned: 0 in 1.225s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-038f7e6e-1806-478d-bafc-a1c331574adf {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:19 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-038f7e6e-1806-478d-bafc-a1c331574adf Apr 29 06:40:19 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:20 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-038f7e6e-1806-478d-bafc-a1c331574adf" returned: 0 in 0.738s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] <== create_volume: return (2015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:40:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23488ba4-32d6-4989-aa35-a572c3dbb72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-038f7e6e-1806-478d-bafc-a1c331574adf', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab900c5-2a1b-4f75-b836-e25dd40bcddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:20 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Volume volume-038f7e6e-1806-478d-bafc-a1c331574adf (038f7e6e-1806-478d-bafc-a1c331574adf): created successfully Apr 29 06:40:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab900c5-2a1b-4f75-b836-e25dd40bcddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Flow 'volume_create_manager' (4d1219e8-ee5c-4c60-a216-615cbdfaf02a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:40:20 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-e7ae6927-5bdc-4f28-afc1-56f6d59d7025 tempest-VolumesMetadataTest-2077817384 None] Created volume successfully. Apr 29 06:40:21 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:40:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Flow 'volume_create_manager' (5544f121-1792-4490-bdc2-68785b93d812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:40:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36753818-f450-49eb-8cb1-6cacb37a78ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36753818-f450-49eb-8cb1-6cacb37a78ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-891102594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fccd71bf-c646-4a59-ae0a-c59a809fa439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c5b61a403443a5a1dfbf1fa8e781f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:40:21Z,use_quota=True,user_id='3ad76fb7dc674c83963836ec4faf688e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c13575d-8dad-4c1b-a6da-a4d8b485a444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c13575d-8dad-4c1b-a6da-a4d8b485a444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c3a12d-de84-468a-b71d-75f4bd1ea366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c3a12d-de84-468a-b71d-75f4bd1ea366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fccd71bf-c646-4a59-ae0a-c59a809fa439', 'volume_name': 'volume-fccd71bf-c646-4a59-ae0a-c59a809fa439', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1c9ea5-a049-48c3-9406-0c7b98552ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1c9ea5-a049-48c3-9406-0c7b98552ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d87ac5-f3fc-49fa-962f-420c6899ae3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:21 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Volume fccd71bf-c646-4a59-ae0a-c59a809fa439: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fccd71bf-c646-4a59-ae0a-c59a809fa439', 'volume_size': 1} Apr 29 06:40:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:21 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-891102594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fccd71bf-c646-4a59-ae0a-c59a809fa439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c5b61a403443a5a1dfbf1fa8e781f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:40:21Z,use_quota=True,user_id='3ad76fb7dc674c83963836ec4faf688e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:40:21 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Creating volume fccd71bf-c646-4a59-ae0a-c59a809fa439 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:40:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:21 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:40:21 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:40:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:21 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:40:21 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:40:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5bb59b38-4047-4138-89d5-fe0779988bab tempest-VolumesMetadataTest-2077817384 None] Acquiring lock "cinder-038f7e6e-1806-478d-bafc-a1c331574adf-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5bb59b38-4047-4138-89d5-fe0779988bab tempest-VolumesMetadataTest-2077817384 None] Lock "cinder-038f7e6e-1806-478d-bafc-a1c331574adf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:21 devstack sudo[88738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439 1073741824 Apr 29 06:40:21 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5bb59b38-4047-4138-89d5-fe0779988bab tempest-VolumesMetadataTest-2077817384 None] Acquiring lock "cinder-quobyte-038f7e6e-1806-478d-bafc-a1c331574adf" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5bb59b38-4047-4138-89d5-fe0779988bab tempest-VolumesMetadataTest-2077817384 None] Lock "cinder-quobyte-038f7e6e-1806-478d-bafc-a1c331574adf" acquired by "delete_volume" :: waited 0.029s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:21 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62c4292-7a43-499a-b4ff-feccb40a7663]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5bb59b38-4047-4138-89d5-fe0779988bab tempest-VolumesMetadataTest-2077817384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-038f7e6e-1806-478d-bafc-a1c331574adf {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:21 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-038f7e6e-1806-478d-bafc-a1c331574adf Apr 29 06:40:21 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:22 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5bb59b38-4047-4138-89d5-fe0779988bab tempest-VolumesMetadataTest-2077817384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-038f7e6e-1806-478d-bafc-a1c331574adf" returned: 0 in 0.892s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5bb59b38-4047-4138-89d5-fe0779988bab tempest-VolumesMetadataTest-2077817384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-038f7e6e-1806-478d-bafc-a1c331574adf {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:22 devstack sudo[88774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-038f7e6e-1806-478d-bafc-a1c331574adf Apr 29 06:40:22 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:22 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439 1073741824" returned: 0 in 1.147s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:22 devstack sudo[88776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439 Apr 29 06:40:22 devstack sudo[88776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:23 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5bb59b38-4047-4138-89d5-fe0779988bab tempest-VolumesMetadataTest-2077817384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-038f7e6e-1806-478d-bafc-a1c331574adf" returned: 0 in 0.706s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:23 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5bb59b38-4047-4138-89d5-fe0779988bab tempest-VolumesMetadataTest-2077817384 None] Lock "cinder-quobyte-038f7e6e-1806-478d-bafc-a1c331574adf" released by "delete_volume" :: held 1.715s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:23 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-5bb59b38-4047-4138-89d5-fe0779988bab tempest-VolumesMetadataTest-2077817384 None] Created reservations ['84f4054e-c4e3-4029-b29d-6973325eed0e', '47479b3a-780f-4f89-82b6-a121d9a3243f', '1cbd5012-0fd1-474e-a948-5d3043bf1765', 'bc6c8041-c4ad-4f9a-bd53-0bb8d6fabb1c'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:40:23 devstack sudo[88776]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439" returned: 0 in 0.835s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:23 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:40:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.045s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:23 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d87ac5-f3fc-49fa-962f-420c6899ae3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fccd71bf-c646-4a59-ae0a-c59a809fa439', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:23 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3298929e-7b6b-44a3-9c86-0df7eb73a7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:23 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Volume volume-fccd71bf-c646-4a59-ae0a-c59a809fa439 (fccd71bf-c646-4a59-ae0a-c59a809fa439): created successfully Apr 29 06:40:23 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3298929e-7b6b-44a3-9c86-0df7eb73a7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:23 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Flow 'volume_create_manager' (5544f121-1792-4490-bdc2-68785b93d812) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:40:23 devstack cinder-volume[84195]: INFO cinder.volume.manager [req-e37f22ad-9558-45fb-96f6-cb7565b5c29c req-cafb3955-1d8c-446e-ad58-98a85f79729e tempest-VolumesSnapshotsTestJSON-820070487 None] Created volume successfully. Apr 29 06:40:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5bb59b38-4047-4138-89d5-fe0779988bab tempest-VolumesMetadataTest-2077817384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5bb59b38-4047-4138-89d5-fe0779988bab tempest-VolumesMetadataTest-2077817384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:23 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5bb59b38-4047-4138-89d5-fe0779988bab tempest-VolumesMetadataTest-2077817384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:40:23 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5bb59b38-4047-4138-89d5-fe0779988bab tempest-VolumesMetadataTest-2077817384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:40:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5bb59b38-4047-4138-89d5-fe0779988bab tempest-VolumesMetadataTest-2077817384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5bb59b38-4047-4138-89d5-fe0779988bab tempest-VolumesMetadataTest-2077817384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:23 devstack sudo[88802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:40:23 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:24 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5bb59b38-4047-4138-89d5-fe0779988bab tempest-VolumesMetadataTest-2077817384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 1.003s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:24 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-5bb59b38-4047-4138-89d5-fe0779988bab tempest-VolumesMetadataTest-2077817384 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:40:24 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-5bb59b38-4047-4138-89d5-fe0779988bab tempest-VolumesMetadataTest-2077817384 None] Deleted volume successfully. Apr 29 06:40:24 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5bb59b38-4047-4138-89d5-fe0779988bab tempest-VolumesMetadataTest-2077817384 None] Lock "cinder-038f7e6e-1806-478d-bafc-a1c331574adf-delete_volume" released by "delete_volume" :: held 3.241s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-9551e8a1-c93e-4caf-8234-ad4603729686 req-d2561f41-6001-4040-964a-8203c596e99c tempest-VolumesSnapshotsTestJSON-820070487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-9551e8a1-c93e-4caf-8234-ad4603729686 req-d2561f41-6001-4040-964a-8203c596e99c tempest-VolumesSnapshotsTestJSON-820070487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:25 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [req-9551e8a1-c93e-4caf-8234-ad4603729686 req-d2561f41-6001-4040-964a-8203c596e99c tempest-VolumesSnapshotsTestJSON-820070487 None] Creating offline snapshot 8e7f3643-1f80-4c03-b93a-db16740a9321 of volume fccd71bf-c646-4a59-ae0a-c59a809fa439 {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:40:25 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb1f300-4c33-43c5-9f68-f49f31f3cf80]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-9551e8a1-c93e-4caf-8234-ad4603729686 req-d2561f41-6001-4040-964a-8203c596e99c tempest-VolumesSnapshotsTestJSON-820070487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:25 devstack sudo[88822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439 Apr 29 06:40:25 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:26 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-9551e8a1-c93e-4caf-8234-ad4603729686 req-d2561f41-6001-4040-964a-8203c596e99c tempest-VolumesSnapshotsTestJSON-820070487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439" returned: 0 in 1.511s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-9551e8a1-c93e-4caf-8234-ad4603729686 req-d2561f41-6001-4040-964a-8203c596e99c tempest-VolumesSnapshotsTestJSON-820070487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439.8e7f3643-1f80-4c03-b93a-db16740a9321 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:26 devstack sudo[88830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439.8e7f3643-1f80-4c03-b93a-db16740a9321 1G Apr 29 06:40:26 devstack sudo[88830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:28 devstack sudo[88830]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-9551e8a1-c93e-4caf-8234-ad4603729686 req-d2561f41-6001-4040-964a-8203c596e99c tempest-VolumesSnapshotsTestJSON-820070487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439.8e7f3643-1f80-4c03-b93a-db16740a9321 1G" returned: 0 in 1.300s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-9551e8a1-c93e-4caf-8234-ad4603729686 req-d2561f41-6001-4040-964a-8203c596e99c tempest-VolumesSnapshotsTestJSON-820070487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fccd71bf-c646-4a59-ae0a-c59a809fa439 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439.8e7f3643-1f80-4c03-b93a-db16740a9321 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:28 devstack sudo[88836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fccd71bf-c646-4a59-ae0a-c59a809fa439 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439.8e7f3643-1f80-4c03-b93a-db16740a9321 Apr 29 06:40:28 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:29 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-9551e8a1-c93e-4caf-8234-ad4603729686 req-d2561f41-6001-4040-964a-8203c596e99c tempest-VolumesSnapshotsTestJSON-820070487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fccd71bf-c646-4a59-ae0a-c59a809fa439 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439.8e7f3643-1f80-4c03-b93a-db16740a9321" returned: 0 in 1.059s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:29 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [req-9551e8a1-c93e-4caf-8234-ad4603729686 req-d2561f41-6001-4040-964a-8203c596e99c tempest-VolumesSnapshotsTestJSON-820070487 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439.8e7f3643-1f80-4c03-b93a-db16740a9321 is being set with open permissions: ugo+rw Apr 29 06:40:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-9551e8a1-c93e-4caf-8234-ad4603729686 req-d2561f41-6001-4040-964a-8203c596e99c tempest-VolumesSnapshotsTestJSON-820070487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439.8e7f3643-1f80-4c03-b93a-db16740a9321 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:29 devstack sudo[88841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439.8e7f3643-1f80-4c03-b93a-db16740a9321 Apr 29 06:40:29 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:30 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:40:30 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Flow 'volume_create_manager' (7b7b3039-88cb-48f7-9397-d71d3ba76e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:40:30 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df6c92f2-87ee-41c7-9015-b3fec9c6a3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:30 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df6c92f2-87ee-41c7-9015-b3fec9c6a3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1315096840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e4e2cd-7168-4c36-b3cf-4dc135749ee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a50b15f9a24c8b89b33134661807db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:40:30Z,use_quota=True,user_id='f7cf0a6d1dd34522a75788a9abeca4d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:30 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0abaf7-234c-46c5-97d7-d4ff1f37f1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:30 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0abaf7-234c-46c5-97d7-d4ff1f37f1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:30 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6db8ed-6278-4497-a45f-a7b9fed5ae67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:30 devstack cinder-volume[84195]: DEBUG cinder.image.glance [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Creating Keystone auth plugin from conf {{(pid=84195) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 06:40:30 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-9551e8a1-c93e-4caf-8234-ad4603729686 req-d2561f41-6001-4040-964a-8203c596e99c tempest-VolumesSnapshotsTestJSON-820070487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439.8e7f3643-1f80-4c03-b93a-db16740a9321" returned: 0 in 1.367s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-9551e8a1-c93e-4caf-8234-ad4603729686 req-d2561f41-6001-4040-964a-8203c596e99c tempest-VolumesSnapshotsTestJSON-820070487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:30 devstack sudo[88845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439.info Apr 29 06:40:30 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:30 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6db8ed-6278-4497-a45f-a7b9fed5ae67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '92e4e2cd-7168-4c36-b3cf-4dc135749ee2', 'volume_name': 'volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2', 'volume_size': 1, 'image_id': '3c917343-78b7-403b-853d-4aeabac3edf1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c917343-78b7-403b-853d-4aeabac3edf1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0b2d77ae633e436aa18dac7e4fad942b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c917343-78b7-403b-853d-4aeabac3edf1', 'created_at': datetime.datetime(2026, 4, 29, 4, 32, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 4, 32, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c917343-78b7-403b-853d-4aeabac3edf1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:30 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7049c93a-ec55-45ab-9d87-774e3dba916e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:30 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7049c93a-ec55-45ab-9d87-774e3dba916e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:30 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b337967-02da-4b4a-a8ae-069765d881ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:30 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Volume 92e4e2cd-7168-4c36-b3cf-4dc135749ee2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2', 'volume_size': 1, 'image_id': '3c917343-78b7-403b-853d-4aeabac3edf1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c917343-78b7-403b-853d-4aeabac3edf1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0b2d77ae633e436aa18dac7e4fad942b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c917343-78b7-403b-853d-4aeabac3edf1', 'created_at': datetime.datetime(2026, 4, 29, 4, 32, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 4, 32, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c917343-78b7-403b-853d-4aeabac3edf1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 06:40:30 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Trying to clone 92e4e2cd-7168-4c36-b3cf-4dc135749ee2 from image 3c917343-78b7-403b-853d-4aeabac3edf1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3c917343-78b7-403b-853d-4aeabac3edf1', 'metadata': {}}]). {{(pid=84195) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 29 06:40:31 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_m1f568atdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84195) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 06:40:31 devstack cinder-volume[84195]: INFO cinder.image.image_utils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Image download 20.69 MB at 20.69 MB/s Apr 29 06:40:31 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5331a82-134e-4d77-bf24-777e9d5332fc]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_m1f568atdevstack@QuobyteHD {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:31 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-9551e8a1-c93e-4caf-8234-ad4603729686 req-d2561f41-6001-4040-964a-8203c596e99c tempest-VolumesSnapshotsTestJSON-820070487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439.info" returned: 0 in 1.161s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:31 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [req-9551e8a1-c93e-4caf-8234-ad4603729686 req-d2561f41-6001-4040-964a-8203c596e99c tempest-VolumesSnapshotsTestJSON-820070487 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439.info is being set with open permissions: ugo+rw Apr 29 06:40:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-9551e8a1-c93e-4caf-8234-ad4603729686 req-d2561f41-6001-4040-964a-8203c596e99c tempest-VolumesSnapshotsTestJSON-820070487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:31 devstack sudo[88851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439.info Apr 29 06:40:31 devstack sudo[88851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:31 devstack sudo[88849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_m1f568atdevstack@QuobyteHD Apr 29 06:40:31 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:32 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_m1f568atdevstack@QuobyteHD" returned: 0 in 0.964s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:32 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Temporary image 3c917343-78b7-403b-853d-4aeabac3edf1 is fetched for user f7cf0a6d1dd34522a75788a9abeca4d6. {{(pid=84195) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 06:40:32 devstack sudo[88851]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-9551e8a1-c93e-4caf-8234-ad4603729686 req-d2561f41-6001-4040-964a-8203c596e99c tempest-VolumesSnapshotsTestJSON-820070487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439.info" returned: 0 in 0.857s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-9551e8a1-c93e-4caf-8234-ad4603729686 req-d2561f41-6001-4040-964a-8203c596e99c tempest-VolumesSnapshotsTestJSON-820070487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.415s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:32 devstack cinder-volume[84195]: INFO cinder.volume.manager [req-9551e8a1-c93e-4caf-8234-ad4603729686 req-d2561f41-6001-4040-964a-8203c596e99c tempest-VolumesSnapshotsTestJSON-820070487 None] Create snapshot completed successfully Apr 29 06:40:32 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[5208ceaf-2050-42da-8de4-6c232fddabc1]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_m1f568atdevstack@QuobyteHD {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:32 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:40:32 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Flow 'volume_create_manager' (4b0e2e5a-2a6a-4142-bbb3-b98cd8ee696b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:40:32 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d6d3fa-6aaa-44ab-b954-f05f709541d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:32 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d6d3fa-6aaa-44ab-b954-f05f709541d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1093335583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71dfa62c-877d-409b-8ffa-d02aed41884d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14f5b3b7938d46b69ef57023b2776a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:40:33Z,use_quota=True,user_id='73a99084d82746d18c87c3c538e1ef84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:32 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d39232c-992b-46d9-a40b-bdef4741d4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:32 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d39232c-992b-46d9-a40b-bdef4741d4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:32 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e8d0e5-0d8a-4f8c-aa3b-6baed88087da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:32 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e8d0e5-0d8a-4f8c-aa3b-6baed88087da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71dfa62c-877d-409b-8ffa-d02aed41884d', 'volume_name': 'volume-71dfa62c-877d-409b-8ffa-d02aed41884d', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:32 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b664ea8-7960-403b-83cf-9c15a3e156f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:32 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b664ea8-7960-403b-83cf-9c15a3e156f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:32 devstack sudo[88865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_m1f568atdevstack@QuobyteHD Apr 29 06:40:32 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:32 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca84941-b240-4316-8288-2c884c266e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:32 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Volume 71dfa62c-877d-409b-8ffa-d02aed41884d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71dfa62c-877d-409b-8ffa-d02aed41884d', 'volume_size': 1} Apr 29 06:40:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:32 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1093335583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71dfa62c-877d-409b-8ffa-d02aed41884d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14f5b3b7938d46b69ef57023b2776a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:40:33Z,use_quota=True,user_id='73a99084d82746d18c87c3c538e1ef84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:40:32 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Creating volume 71dfa62c-877d-409b-8ffa-d02aed41884d {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:40:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:32 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:40:32 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:40:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:32 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:40:32 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:40:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-71dfa62c-877d-409b-8ffa-d02aed41884d 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:32 devstack sudo[88867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-71dfa62c-877d-409b-8ffa-d02aed41884d 1073741824 Apr 29 06:40:32 devstack sudo[88867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:33 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-305d5a07-a208-44cb-8260-8197bee54ea3 req-aebc9b79-7c79-43cd-a3c6-aaaa1362a838 tempest-VolumesSnapshotsTestJSON-820070487 None] Acquiring lock "cinder-8e7f3643-1f80-4c03-b93a-db16740a9321-delete_snapshot" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:33 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-305d5a07-a208-44cb-8260-8197bee54ea3 req-aebc9b79-7c79-43cd-a3c6-aaaa1362a838 tempest-VolumesSnapshotsTestJSON-820070487 None] Lock "cinder-8e7f3643-1f80-4c03-b93a-db16740a9321-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:33 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-305d5a07-a208-44cb-8260-8197bee54ea3 req-aebc9b79-7c79-43cd-a3c6-aaaa1362a838 tempest-VolumesSnapshotsTestJSON-820070487 None] Acquiring lock "cinder-quobyte-fccd71bf-c646-4a59-ae0a-c59a809fa439" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:33 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-305d5a07-a208-44cb-8260-8197bee54ea3 req-aebc9b79-7c79-43cd-a3c6-aaaa1362a838 tempest-VolumesSnapshotsTestJSON-820070487 None] Lock "cinder-quobyte-fccd71bf-c646-4a59-ae0a-c59a809fa439" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:33 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-305d5a07-a208-44cb-8260-8197bee54ea3 req-aebc9b79-7c79-43cd-a3c6-aaaa1362a838 tempest-VolumesSnapshotsTestJSON-820070487 None] Acquiring lock "cinder-quobyte-8e7f3643-1f80-4c03-b93a-db16740a9321" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:33 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_m1f568atdevstack@QuobyteHD" returned: 0 in 0.882s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:33 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-305d5a07-a208-44cb-8260-8197bee54ea3 req-aebc9b79-7c79-43cd-a3c6-aaaa1362a838 tempest-VolumesSnapshotsTestJSON-820070487 None] Lock "cinder-quobyte-8e7f3643-1f80-4c03-b93a-db16740a9321" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:33 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [req-305d5a07-a208-44cb-8260-8197bee54ea3 req-aebc9b79-7c79-43cd-a3c6-aaaa1362a838 tempest-VolumesSnapshotsTestJSON-820070487 None] Deleting offline snapshot 8e7f3643-1f80-4c03-b93a-db16740a9321 of volume fccd71bf-c646-4a59-ae0a-c59a809fa439 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:40:33 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [req-305d5a07-a208-44cb-8260-8197bee54ea3 req-aebc9b79-7c79-43cd-a3c6-aaaa1362a838 tempest-VolumesSnapshotsTestJSON-820070487 None] snapshot_file for this snap is: volume-fccd71bf-c646-4a59-ae0a-c59a809fa439.8e7f3643-1f80-4c03-b93a-db16740a9321 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:40:33 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbd5294-434a-4697-b938-205802fcab9d]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-305d5a07-a208-44cb-8260-8197bee54ea3 req-aebc9b79-7c79-43cd-a3c6-aaaa1362a838 tempest-VolumesSnapshotsTestJSON-820070487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439.8e7f3643-1f80-4c03-b93a-db16740a9321 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:33 devstack sudo[88876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439.8e7f3643-1f80-4c03-b93a-db16740a9321 Apr 29 06:40:33 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:33 devstack sudo[88867]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-71dfa62c-877d-409b-8ffa-d02aed41884d 1073741824" returned: 0 in 1.035s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-71dfa62c-877d-409b-8ffa-d02aed41884d {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:33 devstack sudo[88895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-71dfa62c-877d-409b-8ffa-d02aed41884d Apr 29 06:40:33 devstack sudo[88895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:34 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-305d5a07-a208-44cb-8260-8197bee54ea3 req-aebc9b79-7c79-43cd-a3c6-aaaa1362a838 tempest-VolumesSnapshotsTestJSON-820070487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439.8e7f3643-1f80-4c03-b93a-db16740a9321" returned: 0 in 0.894s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [req-305d5a07-a208-44cb-8260-8197bee54ea3 req-aebc9b79-7c79-43cd-a3c6-aaaa1362a838 tempest-VolumesSnapshotsTestJSON-820070487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fccd71bf-c646-4a59-ae0a-c59a809fa439(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:40:34 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[992d7520-7603-45a6-a945-e8b66ac6cdc2]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-305d5a07-a208-44cb-8260-8197bee54ea3 req-aebc9b79-7c79-43cd-a3c6-aaaa1362a838 tempest-VolumesSnapshotsTestJSON-820070487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:34 devstack sudo[88895]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-71dfa62c-877d-409b-8ffa-d02aed41884d" returned: 0 in 0.709s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:40:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.051s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1315096840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e4e2cd-7168-4c36-b3cf-4dc135749ee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a50b15f9a24c8b89b33134661807db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:40:30Z,use_quota=True,user_id='f7cf0a6d1dd34522a75788a9abeca4d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:40:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Creating volume 92e4e2cd-7168-4c36-b3cf-4dc135749ee2 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:40:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:40:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:40:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:40:34 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:40:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:34 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca84941-b240-4316-8288-2c884c266e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71dfa62c-877d-409b-8ffa-d02aed41884d', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:34 devstack sudo[88922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2 1073741824 Apr 29 06:40:34 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:34 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1358e4-3adb-4bd4-b551-2203e9a24ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:34 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Volume volume-71dfa62c-877d-409b-8ffa-d02aed41884d (71dfa62c-877d-409b-8ffa-d02aed41884d): created successfully Apr 29 06:40:34 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1358e4-3adb-4bd4-b551-2203e9a24ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:34 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Flow 'volume_create_manager' (4b0e2e5a-2a6a-4142-bbb3-b98cd8ee696b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:40:34 devstack sudo[88921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439 Apr 29 06:40:34 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:34 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-8cf27f50-0c21-4ed4-a773-535f4d04d92d tempest-VolumesListAdminTestJSON-433914676 None] Created volume successfully. Apr 29 06:40:35 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:40:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Flow 'volume_create_manager' (c023e672-796d-4e9b-ba6f-19606b818cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:40:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45060301-9bf8-4706-93ba-e8837b34889a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45060301-9bf8-4706-93ba-e8837b34889a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1061017117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ad4732-4c0c-4941-851a-a9861f4cdbfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14f5b3b7938d46b69ef57023b2776a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:40:35Z,use_quota=True,user_id='73a99084d82746d18c87c3c538e1ef84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb87d0d2-ee1b-4eb5-bbe4-15bce00eb023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb87d0d2-ee1b-4eb5-bbe4-15bce00eb023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6441cd9-4866-4c32-a424-0b6103659ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6441cd9-4866-4c32-a424-0b6103659ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22ad4732-4c0c-4941-851a-a9861f4cdbfa', 'volume_name': 'volume-22ad4732-4c0c-4941-851a-a9861f4cdbfa', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:35 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348880b7-4a79-4eb6-ad32-d0ca43778456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348880b7-4a79-4eb6-ad32-d0ca43778456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c098e7e9-941b-4996-879a-fa5d39346517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:35 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Volume 22ad4732-4c0c-4941-851a-a9861f4cdbfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22ad4732-4c0c-4941-851a-a9861f4cdbfa', 'volume_size': 1} Apr 29 06:40:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-305d5a07-a208-44cb-8260-8197bee54ea3 req-aebc9b79-7c79-43cd-a3c6-aaaa1362a838 tempest-VolumesSnapshotsTestJSON-820070487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439" returned: 0 in 0.917s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-305d5a07-a208-44cb-8260-8197bee54ea3 req-aebc9b79-7c79-43cd-a3c6-aaaa1362a838 tempest-VolumesSnapshotsTestJSON-820070487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439.8e7f3643-1f80-4c03-b93a-db16740a9321 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:35 devstack sudo[88931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439.8e7f3643-1f80-4c03-b93a-db16740a9321 Apr 29 06:40:35 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:35 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2 1073741824" returned: 0 in 1.000s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:35 devstack sudo[88933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2 Apr 29 06:40:35 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:36 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:36 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-305d5a07-a208-44cb-8260-8197bee54ea3 req-aebc9b79-7c79-43cd-a3c6-aaaa1362a838 tempest-VolumesSnapshotsTestJSON-820070487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439.8e7f3643-1f80-4c03-b93a-db16740a9321" returned: 0 in 0.902s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-305d5a07-a208-44cb-8260-8197bee54ea3 req-aebc9b79-7c79-43cd-a3c6-aaaa1362a838 tempest-VolumesSnapshotsTestJSON-820070487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439.8e7f3643-1f80-4c03-b93a-db16740a9321 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2" returned: 0 in 0.733s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:40:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.926s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1061017117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ad4732-4c0c-4941-851a-a9861f4cdbfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14f5b3b7938d46b69ef57023b2776a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:40:35Z,use_quota=True,user_id='73a99084d82746d18c87c3c538e1ef84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:40:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Creating volume 22ad4732-4c0c-4941-851a-a9861f4cdbfa {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:40:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:40:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:40:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:40:36 devstack sudo[88953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439.8e7f3643-1f80-4c03-b93a-db16740a9321 Apr 29 06:40:36 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:36 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:40:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-22ad4732-4c0c-4941-851a-a9861f4cdbfa 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:36 devstack sudo[88955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-22ad4732-4c0c-4941-851a-a9861f4cdbfa 1073741824 Apr 29 06:40:36 devstack sudo[88955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:36 devstack cinder-volume[84195]: DEBUG cinder.volume.volume_utils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Attempting download of 3c917343-78b7-403b-853d-4aeabac3edf1 ((None, [{'url': 'file:///opt/stack/data/glance/images/3c917343-78b7-403b-853d-4aeabac3edf1', 'metadata': {}}])) to volume 92e4e2cd-7168-4c36-b3cf-4dc135749ee2. {{(pid=84195) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 06:40:36 devstack cinder-volume[84195]: DEBUG oslo_service.periodic_task [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84195) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 06:40:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:40:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:40:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:36 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:40:36 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:36 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd82090-6b78-4304-802d-a5fd21deb052]: (4, 'raw') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c917343-78b7-403b-853d-4aeabac3edf1_tag_317v {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:36 devstack sudo[88964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c917343-78b7-403b-853d-4aeabac3edf1_tag_317v Apr 29 06:40:36 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:37 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-305d5a07-a208-44cb-8260-8197bee54ea3 req-aebc9b79-7c79-43cd-a3c6-aaaa1362a838 tempest-VolumesSnapshotsTestJSON-820070487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439.8e7f3643-1f80-4c03-b93a-db16740a9321" returned: 0 in 0.708s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:37 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-305d5a07-a208-44cb-8260-8197bee54ea3 req-aebc9b79-7c79-43cd-a3c6-aaaa1362a838 tempest-VolumesSnapshotsTestJSON-820070487 None] Lock "cinder-quobyte-8e7f3643-1f80-4c03-b93a-db16740a9321" released by "_delete_snapshot" :: held 3.581s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:37 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-305d5a07-a208-44cb-8260-8197bee54ea3 req-aebc9b79-7c79-43cd-a3c6-aaaa1362a838 tempest-VolumesSnapshotsTestJSON-820070487 None] Lock "cinder-quobyte-fccd71bf-c646-4a59-ae0a-c59a809fa439" released by "delete_snapshot" :: held 3.613s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:37 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.670s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:37 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:40:37 devstack cinder-volume[84195]: DEBUG cinder.quota [req-305d5a07-a208-44cb-8260-8197bee54ea3 req-aebc9b79-7c79-43cd-a3c6-aaaa1362a838 tempest-VolumesSnapshotsTestJSON-820070487 None] Created reservations ['8c22c49d-bc30-49d2-aea0-2fea4fbd9114', '39b1dc7f-a9da-407a-9826-43e45d98b49e', '8243ee9e-e969-4441-8965-ad2cdb758d3b', 'e1cdc6e8-32e1-4f33-abc8-879984b2159f'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:40:37 devstack cinder-volume[84195]: INFO cinder.volume.manager [req-305d5a07-a208-44cb-8260-8197bee54ea3 req-aebc9b79-7c79-43cd-a3c6-aaaa1362a838 tempest-VolumesSnapshotsTestJSON-820070487 None] Delete snapshot completed successfully. Apr 29 06:40:37 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-305d5a07-a208-44cb-8260-8197bee54ea3 req-aebc9b79-7c79-43cd-a3c6-aaaa1362a838 tempest-VolumesSnapshotsTestJSON-820070487 None] Lock "cinder-8e7f3643-1f80-4c03-b93a-db16740a9321-delete_snapshot" released by "delete_snapshot" :: held 3.802s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:37 devstack sudo[88955]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-22ad4732-4c0c-4941-851a-a9861f4cdbfa 1073741824" returned: 0 in 1.011s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:37 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c917343-78b7-403b-853d-4aeabac3edf1_tag_317v" returned: 0 in 0.879s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c917343-78b7-403b-853d-4aeabac3edf1_tag_317v {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-22ad4732-4c0c-4941-851a-a9861f4cdbfa {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:37 devstack sudo[88976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-22ad4732-4c0c-4941-851a-a9861f4cdbfa Apr 29 06:40:37 devstack sudo[88976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:37 devstack sudo[88975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c917343-78b7-403b-853d-4aeabac3edf1_tag_317v Apr 29 06:40:37 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:38 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-81a4f4a0-3546-4123-9b3c-40ab84182275 req-a2ff864a-e06d-4340-92a2-64f354da25b7 tempest-VolumesSnapshotsTestJSON-820070487 None] Acquiring lock "cinder-fccd71bf-c646-4a59-ae0a-c59a809fa439-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:38 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-81a4f4a0-3546-4123-9b3c-40ab84182275 req-a2ff864a-e06d-4340-92a2-64f354da25b7 tempest-VolumesSnapshotsTestJSON-820070487 None] Lock "cinder-fccd71bf-c646-4a59-ae0a-c59a809fa439-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:38 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-81a4f4a0-3546-4123-9b3c-40ab84182275 req-a2ff864a-e06d-4340-92a2-64f354da25b7 tempest-VolumesSnapshotsTestJSON-820070487 None] Acquiring lock "cinder-quobyte-fccd71bf-c646-4a59-ae0a-c59a809fa439" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:38 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-81a4f4a0-3546-4123-9b3c-40ab84182275 req-a2ff864a-e06d-4340-92a2-64f354da25b7 tempest-VolumesSnapshotsTestJSON-820070487 None] Lock "cinder-quobyte-fccd71bf-c646-4a59-ae0a-c59a809fa439" acquired by "delete_volume" :: waited 0.019s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:38 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[189cf6e9-b8c1-41b1-94ce-910f21090dbd]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-81a4f4a0-3546-4123-9b3c-40ab84182275 req-a2ff864a-e06d-4340-92a2-64f354da25b7 tempest-VolumesSnapshotsTestJSON-820070487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:38 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c917343-78b7-403b-853d-4aeabac3edf1_tag_317v" returned: 1 in 0.697s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c917343-78b7-403b-853d-4aeabac3edf1_tag_317v' failed. Not Retrying. {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 06:40:38 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f8283e-46f9-4c6f-9abe-1a56fda75038]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:38 devstack sudo[88976]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_m1f568atdevstack@QuobyteHD {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-22ad4732-4c0c-4941-851a-a9861f4cdbfa" returned: 0 in 0.684s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:38 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:40:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:38 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c098e7e9-941b-4996-879a-fa5d39346517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22ad4732-4c0c-4941-851a-a9861f4cdbfa', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:38 devstack sudo[88983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439 Apr 29 06:40:38 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:38 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f9b999-9eb9-4f3b-8470-ecdea2d3e5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:38 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Volume volume-22ad4732-4c0c-4941-851a-a9861f4cdbfa (22ad4732-4c0c-4941-851a-a9861f4cdbfa): created successfully Apr 29 06:40:38 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f9b999-9eb9-4f3b-8470-ecdea2d3e5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:38 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Flow 'volume_create_manager' (c023e672-796d-4e9b-ba6f-19606b818cde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:40:38 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-bbe962c8-472f-4207-bd34-23ef862cc72a tempest-VolumesListAdminTestJSON-433914676 None] Created volume successfully. Apr 29 06:40:38 devstack sudo[88984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_m1f568atdevstack@QuobyteHD Apr 29 06:40:38 devstack sudo[88984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:38 devstack sudo[88984]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_m1f568atdevstack@QuobyteHD" returned: 0 in 0.762s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:38 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] 3c917343-78b7-403b-853d-4aeabac3edf1 was qcow2, converting to raw {{(pid=84195) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 06:40:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_m1f568atdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:39 devstack sudo[88993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_m1f568atdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2 Apr 29 06:40:39 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:39 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-81a4f4a0-3546-4123-9b3c-40ab84182275 req-a2ff864a-e06d-4340-92a2-64f354da25b7 tempest-VolumesSnapshotsTestJSON-820070487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439" returned: 0 in 0.877s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-81a4f4a0-3546-4123-9b3c-40ab84182275 req-a2ff864a-e06d-4340-92a2-64f354da25b7 tempest-VolumesSnapshotsTestJSON-820070487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:39 devstack sudo[88995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439 Apr 29 06:40:39 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Flow 'volume_create_manager' (260a16cd-7774-4876-8c4b-902db22ea8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4e6f2c-4f4b-4af0-b1f7-fa0a63e82c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4e6f2c-4f4b-4af0-b1f7-fa0a63e82c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1993158538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34c6047-cb7e-4a31-bd01-6daf9d26ccdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14f5b3b7938d46b69ef57023b2776a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:40:39Z,use_quota=True,user_id='73a99084d82746d18c87c3c538e1ef84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ef6833-7a31-49b0-8864-93d4c4c076b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ef6833-7a31-49b0-8864-93d4c4c076b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f0ab36-efc4-4a1a-8164-0c94c70bba1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f0ab36-efc4-4a1a-8164-0c94c70bba1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b34c6047-cb7e-4a31-bd01-6daf9d26ccdf', 'volume_name': 'volume-b34c6047-cb7e-4a31-bd01-6daf9d26ccdf', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f898e1-cbdf-4194-9c74-597efc900b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f898e1-cbdf-4194-9c74-597efc900b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08cd9e9d-1e6e-477a-bcc5-ce0af10ddced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:39 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Volume b34c6047-cb7e-4a31-bd01-6daf9d26ccdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b34c6047-cb7e-4a31-bd01-6daf9d26ccdf', 'volume_size': 1} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1993158538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34c6047-cb7e-4a31-bd01-6daf9d26ccdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14f5b3b7938d46b69ef57023b2776a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:40:39Z,use_quota=True,user_id='73a99084d82746d18c87c3c538e1ef84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Creating volume b34c6047-cb7e-4a31-bd01-6daf9d26ccdf {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:40:39 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b34c6047-cb7e-4a31-bd01-6daf9d26ccdf 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:39 devstack sudo[88999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b34c6047-cb7e-4a31-bd01-6daf9d26ccdf 1073741824 Apr 29 06:40:39 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:39 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-81a4f4a0-3546-4123-9b3c-40ab84182275 req-a2ff864a-e06d-4340-92a2-64f354da25b7 tempest-VolumesSnapshotsTestJSON-820070487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fccd71bf-c646-4a59-ae0a-c59a809fa439" returned: 0 in 0.741s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-81a4f4a0-3546-4123-9b3c-40ab84182275 req-a2ff864a-e06d-4340-92a2-64f354da25b7 tempest-VolumesSnapshotsTestJSON-820070487 None] Lock "cinder-quobyte-fccd71bf-c646-4a59-ae0a-c59a809fa439" released by "delete_volume" :: held 1.697s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG cinder.quota [req-81a4f4a0-3546-4123-9b3c-40ab84182275 req-a2ff864a-e06d-4340-92a2-64f354da25b7 tempest-VolumesSnapshotsTestJSON-820070487 None] Created reservations ['706d0889-fcc6-4571-ba89-d4b9b9735e45', '3211d35c-eddf-4c71-8781-ccd91f6f5a8a', '7ea3f3db-ce33-4a27-8bb0-8c33600aac0f', 'bd8e2b6a-36c6-4903-bac2-9393574176d5'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-81a4f4a0-3546-4123-9b3c-40ab84182275 req-a2ff864a-e06d-4340-92a2-64f354da25b7 tempest-VolumesSnapshotsTestJSON-820070487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-81a4f4a0-3546-4123-9b3c-40ab84182275 req-a2ff864a-e06d-4340-92a2-64f354da25b7 tempest-VolumesSnapshotsTestJSON-820070487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [req-81a4f4a0-3546-4123-9b3c-40ab84182275 req-a2ff864a-e06d-4340-92a2-64f354da25b7 tempest-VolumesSnapshotsTestJSON-820070487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [req-81a4f4a0-3546-4123-9b3c-40ab84182275 req-a2ff864a-e06d-4340-92a2-64f354da25b7 tempest-VolumesSnapshotsTestJSON-820070487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-81a4f4a0-3546-4123-9b3c-40ab84182275 req-a2ff864a-e06d-4340-92a2-64f354da25b7 tempest-VolumesSnapshotsTestJSON-820070487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-81a4f4a0-3546-4123-9b3c-40ab84182275 req-a2ff864a-e06d-4340-92a2-64f354da25b7 tempest-VolumesSnapshotsTestJSON-820070487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:40 devstack sudo[89017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:40:40 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:40 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b34c6047-cb7e-4a31-bd01-6daf9d26ccdf 1073741824" returned: 0 in 1.015s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b34c6047-cb7e-4a31-bd01-6daf9d26ccdf {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:40 devstack sudo[89019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b34c6047-cb7e-4a31-bd01-6daf9d26ccdf Apr 29 06:40:40 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:40 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-81a4f4a0-3546-4123-9b3c-40ab84182275 req-a2ff864a-e06d-4340-92a2-64f354da25b7 tempest-VolumesSnapshotsTestJSON-820070487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.690s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:40 devstack cinder-volume[84195]: DEBUG cinder.manager [req-81a4f4a0-3546-4123-9b3c-40ab84182275 req-a2ff864a-e06d-4340-92a2-64f354da25b7 tempest-VolumesSnapshotsTestJSON-820070487 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:40:40 devstack cinder-volume[84195]: INFO cinder.volume.manager [req-81a4f4a0-3546-4123-9b3c-40ab84182275 req-a2ff864a-e06d-4340-92a2-64f354da25b7 tempest-VolumesSnapshotsTestJSON-820070487 None] Deleted volume successfully. Apr 29 06:40:40 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-81a4f4a0-3546-4123-9b3c-40ab84182275 req-a2ff864a-e06d-4340-92a2-64f354da25b7 tempest-VolumesSnapshotsTestJSON-820070487 None] Lock "cinder-fccd71bf-c646-4a59-ae0a-c59a809fa439-delete_volume" released by "delete_volume" :: held 2.668s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:41 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b34c6047-cb7e-4a31-bd01-6daf9d26ccdf" returned: 0 in 0.854s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:41 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] <== create_volume: return (1955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:40:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08cd9e9d-1e6e-477a-bcc5-ce0af10ddced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b34c6047-cb7e-4a31-bd01-6daf9d26ccdf', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dcfa4af-1f16-4521-977d-3741769118ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:41 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Volume volume-b34c6047-cb7e-4a31-bd01-6daf9d26ccdf (b34c6047-cb7e-4a31-bd01-6daf9d26ccdf): created successfully Apr 29 06:40:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dcfa4af-1f16-4521-977d-3741769118ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Flow 'volume_create_manager' (260a16cd-7774-4876-8c4b-902db22ea8a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:40:41 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-1eabfd1e-39eb-4759-a453-99db6735fbcb tempest-VolumesListAdminTestJSON-433914676 None] Created volume successfully. Apr 29 06:40:41 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_m1f568atdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2" returned: 0 in 2.597s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:41 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_m1f568atdevstack@QuobyteHD, size 112.00 MB, duration 2.60 sec, destination /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2 {{(pid=84195) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 06:40:41 devstack cinder-volume[84195]: INFO cinder.image.image_utils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Converted 112.00 MB image at 43.07 MB/s Apr 29 06:40:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:41 devstack sudo[89059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2 1G Apr 29 06:40:41 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:42 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2 1G" returned: 0 in 0.785s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:42 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[a580b30d-4fbf-470a-a8c8-7226ff8d0532]: (4, 'raw') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:42 devstack sudo[89066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2 Apr 29 06:40:42 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:43 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2" returned: 0 in 1.185s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:43 devstack sudo[89071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2 Apr 29 06:40:43 devstack sudo[89071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:43 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:40:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Flow 'volume_create_manager' (fddec70d-4869-4cd0-8524-f077f9001f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:40:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f41d035-6c8f-41ea-a786-7df8700095db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f41d035-6c8f-41ea-a786-7df8700095db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c32a19ba-2fd7-443b-83dd-a6f52c55c6c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cc08b244ff34dfb9780fff07fa288c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:40:44Z,use_quota=True,user_id='99d56e1a3ee74b6d96d4fbe58b1f609b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b085ff5-0f82-4395-8058-04b6d43ea211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b085ff5-0f82-4395-8058-04b6d43ea211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2322a7ba-06f5-4b7c-9f0a-97130d6de595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2322a7ba-06f5-4b7c-9f0a-97130d6de595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c32a19ba-2fd7-443b-83dd-a6f52c55c6c9', 'volume_name': 'volume-c32a19ba-2fd7-443b-83dd-a6f52c55c6c9', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ce8062-949f-4987-93e8-404c6467cc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ce8062-949f-4987-93e8-404c6467cc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a0d5fa-19ac-47ca-9a37-6271822f6684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:44 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Volume c32a19ba-2fd7-443b-83dd-a6f52c55c6c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c32a19ba-2fd7-443b-83dd-a6f52c55c6c9', 'volume_size': 1} Apr 29 06:40:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c32a19ba-2fd7-443b-83dd-a6f52c55c6c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cc08b244ff34dfb9780fff07fa288c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:40:44Z,use_quota=True,user_id='99d56e1a3ee74b6d96d4fbe58b1f609b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:40:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Creating volume c32a19ba-2fd7-443b-83dd-a6f52c55c6c9 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:40:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:40:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:40:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:40:44 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:40:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c32a19ba-2fd7-443b-83dd-a6f52c55c6c9 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:44 devstack sudo[89073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c32a19ba-2fd7-443b-83dd-a6f52c55c6c9 1073741824 Apr 29 06:40:44 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:44 devstack sudo[89071]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2" returned: 1 in 1.396s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2' failed. Not Retrying. {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 06:40:45 devstack cinder-volume[84195]: DEBUG cinder.volume.volume_utils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Downloaded image 3c917343-78b7-403b-853d-4aeabac3edf1 ((None, [{'url': 'file:///opt/stack/data/glance/images/3c917343-78b7-403b-853d-4aeabac3edf1', 'metadata': {}}])) to volume 92e4e2cd-7168-4c36-b3cf-4dc135749ee2 successfully. {{(pid=84195) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 06:40:45 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Temporary image 3c917343-78b7-403b-853d-4aeabac3edf1 for user f7cf0a6d1dd34522a75788a9abeca4d6 is deleted. {{(pid=84195) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 06:40:45 devstack cinder-volume[84195]: DEBUG cinder.volume.volume_utils [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Marking volume 92e4e2cd-7168-4c36-b3cf-4dc135749ee2 as bootable. {{(pid=84195) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 06:40:45 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Copying metadata from image 3c917343-78b7-403b-853d-4aeabac3edf1 to 92e4e2cd-7168-4c36-b3cf-4dc135749ee2. {{(pid=84195) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 06:40:45 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Creating volume glance metadata for volume 92e4e2cd-7168-4c36-b3cf-4dc135749ee2 backed by image 3c917343-78b7-403b-853d-4aeabac3edf1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3c917343-78b7-403b-853d-4aeabac3edf1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84195) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 06:40:45 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b337967-02da-4b4a-a8ae-069765d881ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2', 'volume_size': 1, 'image_id': '3c917343-78b7-403b-853d-4aeabac3edf1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c917343-78b7-403b-853d-4aeabac3edf1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0b2d77ae633e436aa18dac7e4fad942b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c917343-78b7-403b-853d-4aeabac3edf1', 'created_at': datetime.datetime(2026, 4, 29, 4, 32, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 4, 32, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c917343-78b7-403b-853d-4aeabac3edf1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddada146-1d44-4465-a940-a3a4dc9364d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c32a19ba-2fd7-443b-83dd-a6f52c55c6c9 1073741824" returned: 0 in 1.250s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:45 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Volume volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2 (92e4e2cd-7168-4c36-b3cf-4dc135749ee2): created successfully Apr 29 06:40:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddada146-1d44-4465-a940-a3a4dc9364d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Flow 'volume_create_manager' (7b7b3039-88cb-48f7-9397-d71d3ba76e2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:40:45 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-e0a03281-6c37-4861-846d-d0f55495725e tempest-VolumesExtendTest-294590726 None] Created volume successfully. Apr 29 06:40:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c32a19ba-2fd7-443b-83dd-a6f52c55c6c9 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:45 devstack sudo[89082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c32a19ba-2fd7-443b-83dd-a6f52c55c6c9 Apr 29 06:40:45 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:46 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c32a19ba-2fd7-443b-83dd-a6f52c55c6c9" returned: 0 in 0.666s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] <== create_volume: return (2022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.025s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a0d5fa-19ac-47ca-9a37-6271822f6684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c32a19ba-2fd7-443b-83dd-a6f52c55c6c9', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b08449-242c-43f2-a8de-3deb48352e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:46 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Volume volume-c32a19ba-2fd7-443b-83dd-a6f52c55c6c9 (c32a19ba-2fd7-443b-83dd-a6f52c55c6c9): created successfully Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b08449-242c-43f2-a8de-3deb48352e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Flow 'volume_create_manager' (fddec70d-4869-4cd0-8524-f077f9001f1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:40:46 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-c24b2c15-fba6-4669-9d25-1142755b245b tempest-VolumesListAdminTestJSON-533454750 None] Created volume successfully. Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Flow 'volume_create_manager' (1e7b1c79-f37c-44e9-be93-b6c500afc5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ce22a8-50ba-49f5-b0b1-b23d5cfeea42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ce22a8-50ba-49f5-b0b1-b23d5cfeea42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1413271115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5873554-6ee4-4ac4-83da-b1e458e83f4c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='17f1ddb09b19477bbd7ba393fd9e3eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:40:46Z,use_quota=True,user_id='2fddd95aea6a4927a4f8acb0f14fab74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59296fba-3900-4812-adfd-6208fc2e5e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59296fba-3900-4812-adfd-6208fc2e5e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1267e2b9-9e1b-4cc7-b886-befafc209975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1267e2b9-9e1b-4cc7-b886-befafc209975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5873554-6ee4-4ac4-83da-b1e458e83f4c', 'volume_name': 'volume-c5873554-6ee4-4ac4-83da-b1e458e83f4c', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153b363d-da67-4931-a5f9-87cf2955d20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153b363d-da67-4931-a5f9-87cf2955d20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b386c75b-0c6b-4721-a072-9553ccb88937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:46 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Volume c5873554-6ee4-4ac4-83da-b1e458e83f4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5873554-6ee4-4ac4-83da-b1e458e83f4c', 'volume_size': 1} Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1413271115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5873554-6ee4-4ac4-83da-b1e458e83f4c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='17f1ddb09b19477bbd7ba393fd9e3eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:40:46Z,use_quota=True,user_id='2fddd95aea6a4927a4f8acb0f14fab74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Creating volume c5873554-6ee4-4ac4-83da-b1e458e83f4c {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:40:46 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c5873554-6ee4-4ac4-83da-b1e458e83f4c 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-482fb574-ae48-423f-bac9-b20520726780 tempest-VolumesExtendTest-294590726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:46 devstack sudo[89117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c5873554-6ee4-4ac4-83da-b1e458e83f4c 1073741824 Apr 29 06:40:46 devstack sudo[89117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8856feaa-d881-41c9-b3a2-a2892e1c5b44 tempest-VolumesListAdminTestJSON-533454750 None] Acquiring lock "cinder-c32a19ba-2fd7-443b-83dd-a6f52c55c6c9-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8856feaa-d881-41c9-b3a2-a2892e1c5b44 tempest-VolumesListAdminTestJSON-533454750 None] Lock "cinder-c32a19ba-2fd7-443b-83dd-a6f52c55c6c9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8856feaa-d881-41c9-b3a2-a2892e1c5b44 tempest-VolumesListAdminTestJSON-533454750 None] Acquiring lock "cinder-quobyte-c32a19ba-2fd7-443b-83dd-a6f52c55c6c9" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8856feaa-d881-41c9-b3a2-a2892e1c5b44 tempest-VolumesListAdminTestJSON-533454750 None] Lock "cinder-quobyte-c32a19ba-2fd7-443b-83dd-a6f52c55c6c9" acquired by "delete_volume" :: waited 0.041s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:47 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc06daa1-4728-4c9c-9231-87a692892971]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8856feaa-d881-41c9-b3a2-a2892e1c5b44 tempest-VolumesListAdminTestJSON-533454750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c32a19ba-2fd7-443b-83dd-a6f52c55c6c9 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-442f8d97-7348-41fb-b259-59d092c51cc5 tempest-VolumesListAdminTestJSON-433914676 None] Acquiring lock "cinder-b34c6047-cb7e-4a31-bd01-6daf9d26ccdf-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-442f8d97-7348-41fb-b259-59d092c51cc5 tempest-VolumesListAdminTestJSON-433914676 None] Lock "cinder-b34c6047-cb7e-4a31-bd01-6daf9d26ccdf-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-442f8d97-7348-41fb-b259-59d092c51cc5 tempest-VolumesListAdminTestJSON-433914676 None] Acquiring lock "cinder-quobyte-b34c6047-cb7e-4a31-bd01-6daf9d26ccdf" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-442f8d97-7348-41fb-b259-59d092c51cc5 tempest-VolumesListAdminTestJSON-433914676 None] Lock "cinder-quobyte-b34c6047-cb7e-4a31-bd01-6daf9d26ccdf" acquired by "delete_volume" :: waited 0.038s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:47 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f115768-39d8-49b9-b0aa-0aca681062d4]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-442f8d97-7348-41fb-b259-59d092c51cc5 tempest-VolumesListAdminTestJSON-433914676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b34c6047-cb7e-4a31-bd01-6daf9d26ccdf {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:47 devstack sudo[89155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c32a19ba-2fd7-443b-83dd-a6f52c55c6c9 Apr 29 06:40:47 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:47 devstack sudo[89117]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c5873554-6ee4-4ac4-83da-b1e458e83f4c 1073741824" returned: 0 in 1.180s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:47 devstack sudo[89157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b34c6047-cb7e-4a31-bd01-6daf9d26ccdf Apr 29 06:40:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c5873554-6ee4-4ac4-83da-b1e458e83f4c {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:47 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:47 devstack sudo[89161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c5873554-6ee4-4ac4-83da-b1e458e83f4c Apr 29 06:40:47 devstack sudo[89161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:48 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8856feaa-d881-41c9-b3a2-a2892e1c5b44 tempest-VolumesListAdminTestJSON-533454750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c32a19ba-2fd7-443b-83dd-a6f52c55c6c9" returned: 0 in 1.293s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8856feaa-d881-41c9-b3a2-a2892e1c5b44 tempest-VolumesListAdminTestJSON-533454750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c32a19ba-2fd7-443b-83dd-a6f52c55c6c9 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:48 devstack sudo[89171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c32a19ba-2fd7-443b-83dd-a6f52c55c6c9 Apr 29 06:40:48 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:48 devstack sudo[89161]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c5873554-6ee4-4ac4-83da-b1e458e83f4c" returned: 0 in 0.902s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:48 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] <== create_volume: return (2152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:40:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.156s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:48 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-482fb574-ae48-423f-bac9-b20520726780 tempest-VolumesExtendTest-294590726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.128s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-442f8d97-7348-41fb-b259-59d092c51cc5 tempest-VolumesListAdminTestJSON-433914676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b34c6047-cb7e-4a31-bd01-6daf9d26ccdf" returned: 0 in 1.117s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-442f8d97-7348-41fb-b259-59d092c51cc5 tempest-VolumesListAdminTestJSON-433914676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b34c6047-cb7e-4a31-bd01-6daf9d26ccdf {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:48 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b34c6047-cb7e-4a31-bd01-6daf9d26ccdf Apr 29 06:40:48 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b386c75b-0c6b-4721-a072-9553ccb88937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5873554-6ee4-4ac4-83da-b1e458e83f4c', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf2e5c88-9b59-4df2-aada-97677f0aa133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:48 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e83bdc-946f-4e16-ae7d-b621d49e72bf]: (4, 'raw') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-482fb574-ae48-423f-bac9-b20520726780 tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:48 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Volume volume-c5873554-6ee4-4ac4-83da-b1e458e83f4c (c5873554-6ee4-4ac4-83da-b1e458e83f4c): created successfully Apr 29 06:40:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf2e5c88-9b59-4df2-aada-97677f0aa133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Flow 'volume_create_manager' (1e7b1c79-f37c-44e9-be93-b6c500afc5ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:40:49 devstack cinder-volume[84195]: INFO cinder.volume.manager [req-6b54dc0a-e099-4c19-9adc-e82eea7ceb26 req-7217f7b8-020c-47da-96c9-52f3e40f9c86 tempest-VolumesGetTestJSON-1978664559 None] Created volume successfully. Apr 29 06:40:49 devstack sudo[89175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2 Apr 29 06:40:49 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:49 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-442f8d97-7348-41fb-b259-59d092c51cc5 tempest-VolumesListAdminTestJSON-433914676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b34c6047-cb7e-4a31-bd01-6daf9d26ccdf" returned: 0 in 0.811s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:49 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8856feaa-d881-41c9-b3a2-a2892e1c5b44 tempest-VolumesListAdminTestJSON-533454750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c32a19ba-2fd7-443b-83dd-a6f52c55c6c9" returned: 0 in 0.892s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:49 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-442f8d97-7348-41fb-b259-59d092c51cc5 tempest-VolumesListAdminTestJSON-433914676 None] Lock "cinder-quobyte-b34c6047-cb7e-4a31-bd01-6daf9d26ccdf" released by "delete_volume" :: held 2.016s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:49 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8856feaa-d881-41c9-b3a2-a2892e1c5b44 tempest-VolumesListAdminTestJSON-533454750 None] Lock "cinder-quobyte-c32a19ba-2fd7-443b-83dd-a6f52c55c6c9" released by "delete_volume" :: held 2.261s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:49 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-442f8d97-7348-41fb-b259-59d092c51cc5 tempest-VolumesListAdminTestJSON-433914676 None] Created reservations ['ea279294-cb8b-407e-b0e9-e3cd1cb2526e', '8046a5b2-39b8-44a5-876a-b411a2bc5191', '193489f5-9fcd-489e-ae37-832b286d6ac0', '316a75c3-871e-4254-acc2-0598d5b99536'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:40:49 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-8856feaa-d881-41c9-b3a2-a2892e1c5b44 tempest-VolumesListAdminTestJSON-533454750 None] Created reservations ['c5febf60-c2e2-4b7f-879a-4b7a5d2764f6', 'a3e9b363-a30c-47f3-a229-e7ad9de70c21', '5f96b6a1-0dcd-4988-bfa6-5638f1141781', 'f0141654-6e95-4985-898b-9f093276f456'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:40:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8856feaa-d881-41c9-b3a2-a2892e1c5b44 tempest-VolumesListAdminTestJSON-533454750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8856feaa-d881-41c9-b3a2-a2892e1c5b44 tempest-VolumesListAdminTestJSON-533454750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8856feaa-d881-41c9-b3a2-a2892e1c5b44 tempest-VolumesListAdminTestJSON-533454750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:40:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8856feaa-d881-41c9-b3a2-a2892e1c5b44 tempest-VolumesListAdminTestJSON-533454750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:40:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8856feaa-d881-41c9-b3a2-a2892e1c5b44 tempest-VolumesListAdminTestJSON-533454750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8856feaa-d881-41c9-b3a2-a2892e1c5b44 tempest-VolumesListAdminTestJSON-533454750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-442f8d97-7348-41fb-b259-59d092c51cc5 tempest-VolumesListAdminTestJSON-433914676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-442f8d97-7348-41fb-b259-59d092c51cc5 tempest-VolumesListAdminTestJSON-433914676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-442f8d97-7348-41fb-b259-59d092c51cc5 tempest-VolumesListAdminTestJSON-433914676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:40:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-442f8d97-7348-41fb-b259-59d092c51cc5 tempest-VolumesListAdminTestJSON-433914676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:40:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-442f8d97-7348-41fb-b259-59d092c51cc5 tempest-VolumesListAdminTestJSON-433914676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-442f8d97-7348-41fb-b259-59d092c51cc5 tempest-VolumesListAdminTestJSON-433914676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:50 devstack sudo[89181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:40:50 devstack sudo[89181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:50 devstack sudo[89182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:40:50 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:50 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-482fb574-ae48-423f-bac9-b20520726780 tempest-VolumesExtendTest-294590726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2" returned: 0 in 1.237s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-482fb574-ae48-423f-bac9-b20520726780 tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:50 devstack sudo[89185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2 Apr 29 06:40:50 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:50 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-6db64cfc-8127-4601-a61a-0eedf8f30957 req-96f731c0-5254-4ce6-973a-1ed3b8fb7c93 tempest-VolumesGetTestJSON-1978664559 None] Acquiring lock "cinder-c5873554-6ee4-4ac4-83da-b1e458e83f4c-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:50 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-6db64cfc-8127-4601-a61a-0eedf8f30957 req-96f731c0-5254-4ce6-973a-1ed3b8fb7c93 tempest-VolumesGetTestJSON-1978664559 None] Lock "cinder-c5873554-6ee4-4ac4-83da-b1e458e83f4c-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:50 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-6db64cfc-8127-4601-a61a-0eedf8f30957 req-96f731c0-5254-4ce6-973a-1ed3b8fb7c93 tempest-VolumesGetTestJSON-1978664559 None] Acquiring lock "cinder-quobyte-c5873554-6ee4-4ac4-83da-b1e458e83f4c" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:50 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-6db64cfc-8127-4601-a61a-0eedf8f30957 req-96f731c0-5254-4ce6-973a-1ed3b8fb7c93 tempest-VolumesGetTestJSON-1978664559 None] Lock "cinder-quobyte-c5873554-6ee4-4ac4-83da-b1e458e83f4c" acquired by "delete_volume" :: waited 0.060s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:50 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9451471-1d20-44bc-9b6a-b0b003fd28d9]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-6db64cfc-8127-4601-a61a-0eedf8f30957 req-96f731c0-5254-4ce6-973a-1ed3b8fb7c93 tempest-VolumesGetTestJSON-1978664559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c5873554-6ee4-4ac4-83da-b1e458e83f4c {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:51 devstack sudo[89181]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8856feaa-d881-41c9-b3a2-a2892e1c5b44 tempest-VolumesListAdminTestJSON-533454750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 1.171s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:51 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-8856feaa-d881-41c9-b3a2-a2892e1c5b44 tempest-VolumesListAdminTestJSON-533454750 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:40:51 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-34234373-27d7-4f78-ab2f-289ea4233183 tempest-VolumesListAdminTestJSON-433914676 None] Acquiring lock "cinder-22ad4732-4c0c-4941-851a-a9861f4cdbfa-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:51 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-8856feaa-d881-41c9-b3a2-a2892e1c5b44 tempest-VolumesListAdminTestJSON-533454750 None] Deleted volume successfully. Apr 29 06:40:51 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-34234373-27d7-4f78-ab2f-289ea4233183 tempest-VolumesListAdminTestJSON-433914676 None] Lock "cinder-22ad4732-4c0c-4941-851a-a9861f4cdbfa-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:51 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8856feaa-d881-41c9-b3a2-a2892e1c5b44 tempest-VolumesListAdminTestJSON-533454750 None] Lock "cinder-c32a19ba-2fd7-443b-83dd-a6f52c55c6c9-delete_volume" released by "delete_volume" :: held 3.931s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:51 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-34234373-27d7-4f78-ab2f-289ea4233183 tempest-VolumesListAdminTestJSON-433914676 None] Acquiring lock "cinder-quobyte-22ad4732-4c0c-4941-851a-a9861f4cdbfa" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:51 devstack sudo[89189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c5873554-6ee4-4ac4-83da-b1e458e83f4c Apr 29 06:40:51 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:51 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-34234373-27d7-4f78-ab2f-289ea4233183 tempest-VolumesListAdminTestJSON-433914676 None] Lock "cinder-quobyte-22ad4732-4c0c-4941-851a-a9861f4cdbfa" acquired by "delete_volume" :: waited 0.026s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:51 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b66f59-7d2d-4d98-b057-1a322a25b99b]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-34234373-27d7-4f78-ab2f-289ea4233183 tempest-VolumesListAdminTestJSON-433914676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-22ad4732-4c0c-4941-851a-a9861f4cdbfa {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:51 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-442f8d97-7348-41fb-b259-59d092c51cc5 tempest-VolumesListAdminTestJSON-433914676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 1.546s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:51 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-442f8d97-7348-41fb-b259-59d092c51cc5 tempest-VolumesListAdminTestJSON-433914676 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:40:51 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-442f8d97-7348-41fb-b259-59d092c51cc5 tempest-VolumesListAdminTestJSON-433914676 None] Deleted volume successfully. Apr 29 06:40:51 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-442f8d97-7348-41fb-b259-59d092c51cc5 tempest-VolumesListAdminTestJSON-433914676 None] Lock "cinder-b34c6047-cb7e-4a31-bd01-6daf9d26ccdf-delete_volume" released by "delete_volume" :: held 4.045s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:51 devstack sudo[89198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-22ad4732-4c0c-4941-851a-a9861f4cdbfa Apr 29 06:40:51 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:51 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-482fb574-ae48-423f-bac9-b20520726780 tempest-VolumesExtendTest-294590726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2" returned: 1 in 1.682s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-482fb574-ae48-423f-bac9-b20520726780 tempest-VolumesExtendTest-294590726 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2' failed. Not Retrying. {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 06:40:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-482fb574-ae48-423f-bac9-b20520726780 tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2 2G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-482fb574-ae48-423f-bac9-b20520726780 tempest-VolumesExtendTest-294590726 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2 2G" returned: 0 in 0.135s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-482fb574-ae48-423f-bac9-b20520726780 tempest-VolumesExtendTest-294590726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 3.157s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:52 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-482fb574-ae48-423f-bac9-b20520726780 tempest-VolumesExtendTest-294590726 None] Extend volume completed successfully. Apr 29 06:40:52 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-6db64cfc-8127-4601-a61a-0eedf8f30957 req-96f731c0-5254-4ce6-973a-1ed3b8fb7c93 tempest-VolumesGetTestJSON-1978664559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c5873554-6ee4-4ac4-83da-b1e458e83f4c" returned: 0 in 1.421s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-6db64cfc-8127-4601-a61a-0eedf8f30957 req-96f731c0-5254-4ce6-973a-1ed3b8fb7c93 tempest-VolumesGetTestJSON-1978664559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c5873554-6ee4-4ac4-83da-b1e458e83f4c {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:52 devstack sudo[89237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c5873554-6ee4-4ac4-83da-b1e458e83f4c Apr 29 06:40:52 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:52 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-34234373-27d7-4f78-ab2f-289ea4233183 tempest-VolumesListAdminTestJSON-433914676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-22ad4732-4c0c-4941-851a-a9861f4cdbfa" returned: 0 in 0.991s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-34234373-27d7-4f78-ab2f-289ea4233183 tempest-VolumesListAdminTestJSON-433914676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-22ad4732-4c0c-4941-851a-a9861f4cdbfa {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:52 devstack sudo[89239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-22ad4732-4c0c-4941-851a-a9861f4cdbfa Apr 29 06:40:52 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:52 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5233d1b0-4076-4e27-b841-c4fdde989ddd tempest-VolumesExtendTest-294590726 None] Acquiring lock "cinder-92e4e2cd-7168-4c36-b3cf-4dc135749ee2-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:52 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5233d1b0-4076-4e27-b841-c4fdde989ddd tempest-VolumesExtendTest-294590726 None] Lock "cinder-92e4e2cd-7168-4c36-b3cf-4dc135749ee2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:52 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5233d1b0-4076-4e27-b841-c4fdde989ddd tempest-VolumesExtendTest-294590726 None] Acquiring lock "cinder-quobyte-92e4e2cd-7168-4c36-b3cf-4dc135749ee2" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:52 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5233d1b0-4076-4e27-b841-c4fdde989ddd tempest-VolumesExtendTest-294590726 None] Lock "cinder-quobyte-92e4e2cd-7168-4c36-b3cf-4dc135749ee2" acquired by "delete_volume" :: waited 0.021s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:52 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7fbf48-f23f-4da8-8303-a4decc3d6c71]: (4, 'raw') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5233d1b0-4076-4e27-b841-c4fdde989ddd tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:52 devstack sudo[89241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2 Apr 29 06:40:52 devstack sudo[89241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-34234373-27d7-4f78-ab2f-289ea4233183 tempest-VolumesListAdminTestJSON-433914676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-22ad4732-4c0c-4941-851a-a9861f4cdbfa" returned: 0 in 0.684s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:53 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:53 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-6db64cfc-8127-4601-a61a-0eedf8f30957 req-96f731c0-5254-4ce6-973a-1ed3b8fb7c93 tempest-VolumesGetTestJSON-1978664559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c5873554-6ee4-4ac4-83da-b1e458e83f4c" returned: 0 in 0.759s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:53 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-34234373-27d7-4f78-ab2f-289ea4233183 tempest-VolumesListAdminTestJSON-433914676 None] Lock "cinder-quobyte-22ad4732-4c0c-4941-851a-a9861f4cdbfa" released by "delete_volume" :: held 1.789s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:53 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-6db64cfc-8127-4601-a61a-0eedf8f30957 req-96f731c0-5254-4ce6-973a-1ed3b8fb7c93 tempest-VolumesGetTestJSON-1978664559 None] Lock "cinder-quobyte-c5873554-6ee4-4ac4-83da-b1e458e83f4c" released by "delete_volume" :: held 2.282s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:53 devstack cinder-volume[84195]: DEBUG cinder.quota [req-6db64cfc-8127-4601-a61a-0eedf8f30957 req-96f731c0-5254-4ce6-973a-1ed3b8fb7c93 tempest-VolumesGetTestJSON-1978664559 None] Created reservations ['09cfe9d4-234e-4c68-9321-df7a1a2df5af', 'ad3f1be0-cdea-409b-9c27-99cf114560ca', 'f8a2613a-09e0-41b5-9b28-b83524ae4925', 'fe1d59e3-96f7-4a05-b799-f4b50fb82e7a'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:40:53 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-34234373-27d7-4f78-ab2f-289ea4233183 tempest-VolumesListAdminTestJSON-433914676 None] Created reservations ['78c805f0-f320-4b5d-a28b-defa2075e44f', '7bea38d3-436f-4198-bd47-0b5660607c23', '08c3662b-80ba-4978-bec2-557cf042da48', '79aa1a7c-2d2c-4614-9c15-d7f702a9ecbd'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:40:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-6db64cfc-8127-4601-a61a-0eedf8f30957 req-96f731c0-5254-4ce6-973a-1ed3b8fb7c93 tempest-VolumesGetTestJSON-1978664559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-6db64cfc-8127-4601-a61a-0eedf8f30957 req-96f731c0-5254-4ce6-973a-1ed3b8fb7c93 tempest-VolumesGetTestJSON-1978664559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:53 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [req-6db64cfc-8127-4601-a61a-0eedf8f30957 req-96f731c0-5254-4ce6-973a-1ed3b8fb7c93 tempest-VolumesGetTestJSON-1978664559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:40:53 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [req-6db64cfc-8127-4601-a61a-0eedf8f30957 req-96f731c0-5254-4ce6-973a-1ed3b8fb7c93 tempest-VolumesGetTestJSON-1978664559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:40:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-6db64cfc-8127-4601-a61a-0eedf8f30957 req-96f731c0-5254-4ce6-973a-1ed3b8fb7c93 tempest-VolumesGetTestJSON-1978664559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-6db64cfc-8127-4601-a61a-0eedf8f30957 req-96f731c0-5254-4ce6-973a-1ed3b8fb7c93 tempest-VolumesGetTestJSON-1978664559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-34234373-27d7-4f78-ab2f-289ea4233183 tempest-VolumesListAdminTestJSON-433914676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-34234373-27d7-4f78-ab2f-289ea4233183 tempest-VolumesListAdminTestJSON-433914676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:53 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-34234373-27d7-4f78-ab2f-289ea4233183 tempest-VolumesListAdminTestJSON-433914676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:40:53 devstack sudo[89246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:40:53 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:53 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-34234373-27d7-4f78-ab2f-289ea4233183 tempest-VolumesListAdminTestJSON-433914676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:40:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-34234373-27d7-4f78-ab2f-289ea4233183 tempest-VolumesListAdminTestJSON-433914676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-34234373-27d7-4f78-ab2f-289ea4233183 tempest-VolumesListAdminTestJSON-433914676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:53 devstack sudo[89250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:40:53 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:53 devstack sudo[89241]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5233d1b0-4076-4e27-b841-c4fdde989ddd tempest-VolumesExtendTest-294590726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2" returned: 0 in 0.947s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5233d1b0-4076-4e27-b841-c4fdde989ddd tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:53 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-e81af45b-e0ff-4bcd-bee7-07d13f293f0a tempest-VolumesListAdminTestJSON-433914676 None] Acquiring lock "cinder-71dfa62c-877d-409b-8ffa-d02aed41884d-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:53 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-e81af45b-e0ff-4bcd-bee7-07d13f293f0a tempest-VolumesListAdminTestJSON-433914676 None] Lock "cinder-71dfa62c-877d-409b-8ffa-d02aed41884d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:53 devstack sudo[89252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2 Apr 29 06:40:53 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:53 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-e81af45b-e0ff-4bcd-bee7-07d13f293f0a tempest-VolumesListAdminTestJSON-433914676 None] Acquiring lock "cinder-quobyte-71dfa62c-877d-409b-8ffa-d02aed41884d" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:53 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-e81af45b-e0ff-4bcd-bee7-07d13f293f0a tempest-VolumesListAdminTestJSON-433914676 None] Lock "cinder-quobyte-71dfa62c-877d-409b-8ffa-d02aed41884d" acquired by "delete_volume" :: waited 0.030s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:53 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68df1b9-2bea-4d68-93e2-bb210ecbca98]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e81af45b-e0ff-4bcd-bee7-07d13f293f0a tempest-VolumesListAdminTestJSON-433914676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-71dfa62c-877d-409b-8ffa-d02aed41884d {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:54 devstack sudo[89255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-71dfa62c-877d-409b-8ffa-d02aed41884d Apr 29 06:40:54 devstack sudo[89255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:54 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-6db64cfc-8127-4601-a61a-0eedf8f30957 req-96f731c0-5254-4ce6-973a-1ed3b8fb7c93 tempest-VolumesGetTestJSON-1978664559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 1.049s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:54 devstack cinder-volume[84195]: DEBUG cinder.manager [req-6db64cfc-8127-4601-a61a-0eedf8f30957 req-96f731c0-5254-4ce6-973a-1ed3b8fb7c93 tempest-VolumesGetTestJSON-1978664559 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:40:54 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:54 devstack cinder-volume[84195]: INFO cinder.volume.manager [req-6db64cfc-8127-4601-a61a-0eedf8f30957 req-96f731c0-5254-4ce6-973a-1ed3b8fb7c93 tempest-VolumesGetTestJSON-1978664559 None] Deleted volume successfully. Apr 29 06:40:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-34234373-27d7-4f78-ab2f-289ea4233183 tempest-VolumesListAdminTestJSON-433914676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 1.007s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:54 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-34234373-27d7-4f78-ab2f-289ea4233183 tempest-VolumesListAdminTestJSON-433914676 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:40:54 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-34234373-27d7-4f78-ab2f-289ea4233183 tempest-VolumesListAdminTestJSON-433914676 None] Deleted volume successfully. Apr 29 06:40:54 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-6db64cfc-8127-4601-a61a-0eedf8f30957 req-96f731c0-5254-4ce6-973a-1ed3b8fb7c93 tempest-VolumesGetTestJSON-1978664559 None] Lock "cinder-c5873554-6ee4-4ac4-83da-b1e458e83f4c-delete_volume" released by "delete_volume" :: held 3.731s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:54 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-34234373-27d7-4f78-ab2f-289ea4233183 tempest-VolumesListAdminTestJSON-433914676 None] Lock "cinder-22ad4732-4c0c-4941-851a-a9861f4cdbfa-delete_volume" released by "delete_volume" :: held 3.208s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:54 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5233d1b0-4076-4e27-b841-c4fdde989ddd tempest-VolumesExtendTest-294590726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2" returned: 1 in 1.029s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5233d1b0-4076-4e27-b841-c4fdde989ddd tempest-VolumesExtendTest-294590726 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2' failed. Not Retrying. {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 06:40:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5233d1b0-4076-4e27-b841-c4fdde989ddd tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:54 devstack sudo[89262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2 Apr 29 06:40:54 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:54 devstack sudo[89255]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e81af45b-e0ff-4bcd-bee7-07d13f293f0a tempest-VolumesListAdminTestJSON-433914676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-71dfa62c-877d-409b-8ffa-d02aed41884d" returned: 0 in 0.912s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e81af45b-e0ff-4bcd-bee7-07d13f293f0a tempest-VolumesListAdminTestJSON-433914676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-71dfa62c-877d-409b-8ffa-d02aed41884d {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:54 devstack sudo[89267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-71dfa62c-877d-409b-8ffa-d02aed41884d Apr 29 06:40:54 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:54 devstack cinder-volume[84195]: INFO cinder.volume.manager [req-1d3fdea4-6f51-4599-9f43-a4f08cf45d22 req-565bc530-56f1-421b-91f5-e1180e86ca12 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Terminate volume connection completed successfully. Apr 29 06:40:54 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-1d3fdea4-6f51-4599-9f43-a4f08cf45d22 req-565bc530-56f1-421b-91f5-e1180e86ca12 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Deleting attachment 9ae2f959-b1d6-41b4-8158-314008118d77. {{(pid=84195) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 06:40:55 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5233d1b0-4076-4e27-b841-c4fdde989ddd tempest-VolumesExtendTest-294590726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-92e4e2cd-7168-4c36-b3cf-4dc135749ee2" returned: 0 in 0.704s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5233d1b0-4076-4e27-b841-c4fdde989ddd tempest-VolumesExtendTest-294590726 None] Lock "cinder-quobyte-92e4e2cd-7168-4c36-b3cf-4dc135749ee2" released by "delete_volume" :: held 2.769s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:55 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-5233d1b0-4076-4e27-b841-c4fdde989ddd tempest-VolumesExtendTest-294590726 None] Created reservations ['451cc5b1-63da-4b36-91ff-ddc43fb8145b', '0acc68c3-2f9e-4f3d-9626-ccaa2db255c2', '68668262-daa0-4a5c-8d7b-d311fbf39c7c', 'a25cf02c-fd11-43a4-9440-c6d3abe36a0f'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:40:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5233d1b0-4076-4e27-b841-c4fdde989ddd tempest-VolumesExtendTest-294590726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5233d1b0-4076-4e27-b841-c4fdde989ddd tempest-VolumesExtendTest-294590726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:55 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5233d1b0-4076-4e27-b841-c4fdde989ddd tempest-VolumesExtendTest-294590726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:40:55 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5233d1b0-4076-4e27-b841-c4fdde989ddd tempest-VolumesExtendTest-294590726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:40:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5233d1b0-4076-4e27-b841-c4fdde989ddd tempest-VolumesExtendTest-294590726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5233d1b0-4076-4e27-b841-c4fdde989ddd tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:55 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e81af45b-e0ff-4bcd-bee7-07d13f293f0a tempest-VolumesListAdminTestJSON-433914676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-71dfa62c-877d-409b-8ffa-d02aed41884d" returned: 0 in 0.742s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:55 devstack sudo[89271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:40:55 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-1d3fdea4-6f51-4599-9f43-a4f08cf45d22 req-57f9ca50-aedc-4831-8662-42189f92a3a1 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Acquiring lock "cinder-ee391713-eeda-422e-abce-8ea949e66356-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-e81af45b-e0ff-4bcd-bee7-07d13f293f0a tempest-VolumesListAdminTestJSON-433914676 None] Lock "cinder-quobyte-71dfa62c-877d-409b-8ffa-d02aed41884d" released by "delete_volume" :: held 1.753s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-1d3fdea4-6f51-4599-9f43-a4f08cf45d22 req-57f9ca50-aedc-4831-8662-42189f92a3a1 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Lock "cinder-ee391713-eeda-422e-abce-8ea949e66356-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-1d3fdea4-6f51-4599-9f43-a4f08cf45d22 req-57f9ca50-aedc-4831-8662-42189f92a3a1 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Acquiring lock "cinder-quobyte-ee391713-eeda-422e-abce-8ea949e66356" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:40:55 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-e81af45b-e0ff-4bcd-bee7-07d13f293f0a tempest-VolumesListAdminTestJSON-433914676 None] Created reservations ['1494c50e-c361-470a-9e5f-b6976099065d', '3c78bd7c-ea74-48ba-879f-41144acec220', 'c849b4be-9674-4f88-b66d-62d87440578e', '4dd24246-69de-4afa-b15a-a0bcd522374d'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:40:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-1d3fdea4-6f51-4599-9f43-a4f08cf45d22 req-57f9ca50-aedc-4831-8662-42189f92a3a1 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Lock "cinder-quobyte-ee391713-eeda-422e-abce-8ea949e66356" acquired by "delete_volume" :: waited 0.038s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:40:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e81af45b-e0ff-4bcd-bee7-07d13f293f0a tempest-VolumesListAdminTestJSON-433914676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e81af45b-e0ff-4bcd-bee7-07d13f293f0a tempest-VolumesListAdminTestJSON-433914676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:55 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e81af45b-e0ff-4bcd-bee7-07d13f293f0a tempest-VolumesListAdminTestJSON-433914676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:40:55 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e81af45b-e0ff-4bcd-bee7-07d13f293f0a tempest-VolumesListAdminTestJSON-433914676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:40:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e81af45b-e0ff-4bcd-bee7-07d13f293f0a tempest-VolumesListAdminTestJSON-433914676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e81af45b-e0ff-4bcd-bee7-07d13f293f0a tempest-VolumesListAdminTestJSON-433914676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:55 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd32ed37-f3de-408a-adc2-2b7fa733d0c3]: (4, 'raw') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:40:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1d3fdea4-6f51-4599-9f43-a4f08cf45d22 req-57f9ca50-aedc-4831-8662-42189f92a3a1 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:55 devstack sudo[89273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:40:55 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:56 devstack sudo[89274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356 Apr 29 06:40:56 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:56 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:40:56 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Flow 'volume_create_manager' (4cf42ea0-9fbe-49dd-9199-5577f3489f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:40:56 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e53de3ae-3305-4699-af18-c58d0fc113db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:56 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e53de3ae-3305-4699-af18-c58d0fc113db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-484466887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0699f44d-af5e-447e-a0d4-038bc0463316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a50b15f9a24c8b89b33134661807db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:40:57Z,use_quota=True,user_id='f7cf0a6d1dd34522a75788a9abeca4d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:56 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8eddef-9328-4132-92de-75421153dd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:56 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8eddef-9328-4132-92de-75421153dd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:56 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d18473-b6ef-4feb-acf2-2994082fdf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:56 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d18473-b6ef-4feb-acf2-2994082fdf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0699f44d-af5e-447e-a0d4-038bc0463316', 'volume_name': 'volume-0699f44d-af5e-447e-a0d4-038bc0463316', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:56 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f245b7-a32e-4e9f-b817-a7810fa25ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:56 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f245b7-a32e-4e9f-b817-a7810fa25ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:56 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:56 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d2e61c2-a854-489a-8997-1d2a95e44202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:56 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Volume 0699f44d-af5e-447e-a0d4-038bc0463316: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0699f44d-af5e-447e-a0d4-038bc0463316', 'volume_size': 1} Apr 29 06:40:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-484466887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0699f44d-af5e-447e-a0d4-038bc0463316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a50b15f9a24c8b89b33134661807db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:40:57Z,use_quota=True,user_id='f7cf0a6d1dd34522a75788a9abeca4d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:40:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Creating volume 0699f44d-af5e-447e-a0d4-038bc0463316 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:40:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:40:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:40:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:40:56 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:40:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5233d1b0-4076-4e27-b841-c4fdde989ddd tempest-VolumesExtendTest-294590726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 1.272s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:56 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-5233d1b0-4076-4e27-b841-c4fdde989ddd tempest-VolumesExtendTest-294590726 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:40:56 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-5233d1b0-4076-4e27-b841-c4fdde989ddd tempest-VolumesExtendTest-294590726 None] Deleted volume successfully. Apr 29 06:40:56 devstack sudo[89279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316 1073741824 Apr 29 06:40:56 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:56 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5233d1b0-4076-4e27-b841-c4fdde989ddd tempest-VolumesExtendTest-294590726 None] Lock "cinder-92e4e2cd-7168-4c36-b3cf-4dc135749ee2-delete_volume" released by "delete_volume" :: held 4.335s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:57 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e81af45b-e0ff-4bcd-bee7-07d13f293f0a tempest-VolumesListAdminTestJSON-433914676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 1.331s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:57 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-e81af45b-e0ff-4bcd-bee7-07d13f293f0a tempest-VolumesListAdminTestJSON-433914676 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:40:57 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-e81af45b-e0ff-4bcd-bee7-07d13f293f0a tempest-VolumesListAdminTestJSON-433914676 None] Deleted volume successfully. Apr 29 06:40:57 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-e81af45b-e0ff-4bcd-bee7-07d13f293f0a tempest-VolumesListAdminTestJSON-433914676 None] Lock "cinder-71dfa62c-877d-409b-8ffa-d02aed41884d-delete_volume" released by "delete_volume" :: held 3.467s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:57 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1d3fdea4-6f51-4599-9f43-a4f08cf45d22 req-57f9ca50-aedc-4831-8662-42189f92a3a1 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356" returned: 0 in 1.420s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1d3fdea4-6f51-4599-9f43-a4f08cf45d22 req-57f9ca50-aedc-4831-8662-42189f92a3a1 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:57 devstack sudo[89284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356 Apr 29 06:40:57 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:58 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316 1073741824" returned: 0 in 1.204s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:58 devstack sudo[89290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316 Apr 29 06:40:58 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:58 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1d3fdea4-6f51-4599-9f43-a4f08cf45d22 req-57f9ca50-aedc-4831-8662-42189f92a3a1 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356" returned: 1 in 1.202s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1d3fdea4-6f51-4599-9f43-a4f08cf45d22 req-57f9ca50-aedc-4831-8662-42189f92a3a1 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356' failed. Not Retrying. {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 06:40:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1d3fdea4-6f51-4599-9f43-a4f08cf45d22 req-57f9ca50-aedc-4831-8662-42189f92a3a1 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:58 devstack sudo[89295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356 Apr 29 06:40:58 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:40:59 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316" returned: 0 in 0.954s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:59 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] <== create_volume: return (2215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:40:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.220s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:59 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d2e61c2-a854-489a-8997-1d2a95e44202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0699f44d-af5e-447e-a0d4-038bc0463316', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:59 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01aab04d-9aa5-4292-9fdb-cb5e839788f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:40:59 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Volume volume-0699f44d-af5e-447e-a0d4-038bc0463316 (0699f44d-af5e-447e-a0d4-038bc0463316): created successfully Apr 29 06:40:59 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01aab04d-9aa5-4292-9fdb-cb5e839788f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:40:59 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Flow 'volume_create_manager' (4cf42ea0-9fbe-49dd-9199-5577f3489f3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:40:59 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-3e02bd2d-6b84-47cc-a0d2-67a393123aec tempest-VolumesExtendTest-294590726 None] Created volume successfully. Apr 29 06:40:59 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root Apr 29 06:40:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1d3fdea4-6f51-4599-9f43-a4f08cf45d22 req-57f9ca50-aedc-4831-8662-42189f92a3a1 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ee391713-eeda-422e-abce-8ea949e66356" returned: 0 in 0.912s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:40:59 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-1d3fdea4-6f51-4599-9f43-a4f08cf45d22 req-57f9ca50-aedc-4831-8662-42189f92a3a1 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Lock "cinder-quobyte-ee391713-eeda-422e-abce-8ea949e66356" released by "delete_volume" :: held 3.690s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:40:59 devstack cinder-volume[84195]: DEBUG cinder.quota [req-1d3fdea4-6f51-4599-9f43-a4f08cf45d22 req-57f9ca50-aedc-4831-8662-42189f92a3a1 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Created reservations ['0b70514b-f10e-4849-94f2-5c68f07d439d', '8d996aca-551e-4c7f-9008-d1bbd27bff49', 'd5b6e076-436a-49d7-aef3-f27032d51ab5', '9fb5c254-baa8-4dcc-ab83-0a49d4f6900d'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:40:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-1d3fdea4-6f51-4599-9f43-a4f08cf45d22 req-57f9ca50-aedc-4831-8662-42189f92a3a1 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:40:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-1d3fdea4-6f51-4599-9f43-a4f08cf45d22 req-57f9ca50-aedc-4831-8662-42189f92a3a1 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:40:59 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [req-1d3fdea4-6f51-4599-9f43-a4f08cf45d22 req-57f9ca50-aedc-4831-8662-42189f92a3a1 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:40:59 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [req-1d3fdea4-6f51-4599-9f43-a4f08cf45d22 req-57f9ca50-aedc-4831-8662-42189f92a3a1 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:40:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-1d3fdea4-6f51-4599-9f43-a4f08cf45d22 req-57f9ca50-aedc-4831-8662-42189f92a3a1 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:40:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1d3fdea4-6f51-4599-9f43-a4f08cf45d22 req-57f9ca50-aedc-4831-8662-42189f92a3a1 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:40:59 devstack sudo[89301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:40:59 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-015e9381-9a1f-4a02-bb37-8dc7f53ede72 tempest-VolumesExtendTest-294590726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-015e9381-9a1f-4a02-bb37-8dc7f53ede72 tempest-VolumesExtendTest-294590726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:00 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-015e9381-9a1f-4a02-bb37-8dc7f53ede72 tempest-VolumesExtendTest-294590726 None] Creating offline snapshot 6c0a2c00-1bcb-483f-905b-f96b5d149ffe of volume 0699f44d-af5e-447e-a0d4-038bc0463316 {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:41:00 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c03454f-13e0-483f-8fa1-eb39b1c68401]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-015e9381-9a1f-4a02-bb37-8dc7f53ede72 tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:00 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-dff5d503-6d62-4483-a894-0aa0052ee31f tempest-BackendsCapabilitiesAdminTestsJSON-1740786740 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.650302886963, 'free_capacity_gb': 1775.650302886963, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84195) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 29 06:41:00 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-1d3fdea4-6f51-4599-9f43-a4f08cf45d22 req-57f9ca50-aedc-4831-8662-42189f92a3a1 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.832s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:00 devstack cinder-volume[84195]: DEBUG cinder.manager [req-1d3fdea4-6f51-4599-9f43-a4f08cf45d22 req-57f9ca50-aedc-4831-8662-42189f92a3a1 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:41:00 devstack cinder-volume[84195]: INFO cinder.volume.manager [req-1d3fdea4-6f51-4599-9f43-a4f08cf45d22 req-57f9ca50-aedc-4831-8662-42189f92a3a1 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Deleted volume successfully. Apr 29 06:41:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-1d3fdea4-6f51-4599-9f43-a4f08cf45d22 req-57f9ca50-aedc-4831-8662-42189f92a3a1 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Lock "cinder-ee391713-eeda-422e-abce-8ea949e66356-delete_volume" released by "delete_volume" :: held 4.802s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:00 devstack sudo[89304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316 Apr 29 06:41:00 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:00 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-da3730af-4ec0-47f6-a512-5a20c608bfed tempest-BackendsCapabilitiesAdminTestsJSON-1740786740 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.650302886963, 'free_capacity_gb': 1775.650302886963, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84195) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 29 06:41:01 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-015e9381-9a1f-4a02-bb37-8dc7f53ede72 tempest-VolumesExtendTest-294590726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316" returned: 0 in 1.215s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-015e9381-9a1f-4a02-bb37-8dc7f53ede72 tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316.6c0a2c00-1bcb-483f-905b-f96b5d149ffe 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:01 devstack sudo[89345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316.6c0a2c00-1bcb-483f-905b-f96b5d149ffe 1G Apr 29 06:41:01 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:02 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-015e9381-9a1f-4a02-bb37-8dc7f53ede72 tempest-VolumesExtendTest-294590726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316.6c0a2c00-1bcb-483f-905b-f96b5d149ffe 1G" returned: 0 in 0.945s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-015e9381-9a1f-4a02-bb37-8dc7f53ede72 tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0699f44d-af5e-447e-a0d4-038bc0463316 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316.6c0a2c00-1bcb-483f-905b-f96b5d149ffe {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:02 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0699f44d-af5e-447e-a0d4-038bc0463316 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316.6c0a2c00-1bcb-483f-905b-f96b5d149ffe Apr 29 06:41:02 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:03 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-015e9381-9a1f-4a02-bb37-8dc7f53ede72 tempest-VolumesExtendTest-294590726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0699f44d-af5e-447e-a0d4-038bc0463316 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316.6c0a2c00-1bcb-483f-905b-f96b5d149ffe" returned: 0 in 0.820s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:03 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-015e9381-9a1f-4a02-bb37-8dc7f53ede72 tempest-VolumesExtendTest-294590726 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316.6c0a2c00-1bcb-483f-905b-f96b5d149ffe is being set with open permissions: ugo+rw Apr 29 06:41:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-015e9381-9a1f-4a02-bb37-8dc7f53ede72 tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316.6c0a2c00-1bcb-483f-905b-f96b5d149ffe {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:03 devstack sudo[89359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316.6c0a2c00-1bcb-483f-905b-f96b5d149ffe Apr 29 06:41:03 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:04 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-015e9381-9a1f-4a02-bb37-8dc7f53ede72 tempest-VolumesExtendTest-294590726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316.6c0a2c00-1bcb-483f-905b-f96b5d149ffe" returned: 0 in 0.683s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-015e9381-9a1f-4a02-bb37-8dc7f53ede72 tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:04 devstack sudo[89362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316.info Apr 29 06:41:04 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:04 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-015e9381-9a1f-4a02-bb37-8dc7f53ede72 tempest-VolumesExtendTest-294590726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316.info" returned: 0 in 0.688s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:04 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-015e9381-9a1f-4a02-bb37-8dc7f53ede72 tempest-VolumesExtendTest-294590726 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316.info is being set with open permissions: ugo+rw Apr 29 06:41:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-015e9381-9a1f-4a02-bb37-8dc7f53ede72 tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:04 devstack sudo[89365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316.info Apr 29 06:41:04 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:05 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-015e9381-9a1f-4a02-bb37-8dc7f53ede72 tempest-VolumesExtendTest-294590726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316.info" returned: 0 in 0.717s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-015e9381-9a1f-4a02-bb37-8dc7f53ede72 tempest-VolumesExtendTest-294590726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.191s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:05 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-015e9381-9a1f-4a02-bb37-8dc7f53ede72 tempest-VolumesExtendTest-294590726 None] Create snapshot completed successfully Apr 29 06:41:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-df27e13b-b2b4-427f-9f0e-1c5c6785b7ea tempest-VolumesExtendTest-294590726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-df27e13b-b2b4-427f-9f0e-1c5c6785b7ea tempest-VolumesExtendTest-294590726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:06 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec8b325-df9c-44c9-867e-a8b58554f203]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-df27e13b-b2b4-427f-9f0e-1c5c6785b7ea tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:06 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316 Apr 29 06:41:06 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:06 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-df27e13b-b2b4-427f-9f0e-1c5c6785b7ea tempest-VolumesExtendTest-294590726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316" returned: 0 in 0.952s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-df27e13b-b2b4-427f-9f0e-1c5c6785b7ea tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316.6c0a2c00-1bcb-483f-905b-f96b5d149ffe 2G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-df27e13b-b2b4-427f-9f0e-1c5c6785b7ea tempest-VolumesExtendTest-294590726 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316.6c0a2c00-1bcb-483f-905b-f96b5d149ffe 2G" returned: 0 in 0.153s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-df27e13b-b2b4-427f-9f0e-1c5c6785b7ea tempest-VolumesExtendTest-294590726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.165s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:07 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-df27e13b-b2b4-427f-9f0e-1c5c6785b7ea tempest-VolumesExtendTest-294590726 None] Extend volume completed successfully. Apr 29 06:41:08 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-bb528407-5646-46ca-a4b9-15465bc80ca4 tempest-GroupSnapshotsTest-841847317 None] Group tempest-GroupSnapshotsTest-Group-1010338453: creating Apr 29 06:41:08 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-bb528407-5646-46ca-a4b9-15465bc80ca4 tempest-GroupSnapshotsTest-841847317 None] Group tempest-GroupSnapshotsTest-Group-1010338453: created successfully Apr 29 06:41:08 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-bb528407-5646-46ca-a4b9-15465bc80ca4 tempest-GroupSnapshotsTest-841847317 None] Create group completed successfully. Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4aa8a1b8-f905-4490-95ff-e1dcd2d06fbc tempest-VolumesExtendTest-294590726 None] Acquiring lock "cinder-6c0a2c00-1bcb-483f-905b-f96b5d149ffe-delete_snapshot" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4aa8a1b8-f905-4490-95ff-e1dcd2d06fbc tempest-VolumesExtendTest-294590726 None] Lock "cinder-6c0a2c00-1bcb-483f-905b-f96b5d149ffe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4aa8a1b8-f905-4490-95ff-e1dcd2d06fbc tempest-VolumesExtendTest-294590726 None] Acquiring lock "cinder-quobyte-0699f44d-af5e-447e-a0d4-038bc0463316" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4aa8a1b8-f905-4490-95ff-e1dcd2d06fbc tempest-VolumesExtendTest-294590726 None] Lock "cinder-quobyte-0699f44d-af5e-447e-a0d4-038bc0463316" acquired by "delete_snapshot" :: waited 0.034s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4aa8a1b8-f905-4490-95ff-e1dcd2d06fbc tempest-VolumesExtendTest-294590726 None] Acquiring lock "cinder-quobyte-6c0a2c00-1bcb-483f-905b-f96b5d149ffe" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4aa8a1b8-f905-4490-95ff-e1dcd2d06fbc tempest-VolumesExtendTest-294590726 None] Lock "cinder-quobyte-6c0a2c00-1bcb-483f-905b-f96b5d149ffe" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-4aa8a1b8-f905-4490-95ff-e1dcd2d06fbc tempest-VolumesExtendTest-294590726 None] Deleting offline snapshot 6c0a2c00-1bcb-483f-905b-f96b5d149ffe of volume 0699f44d-af5e-447e-a0d4-038bc0463316 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-4aa8a1b8-f905-4490-95ff-e1dcd2d06fbc tempest-VolumesExtendTest-294590726 None] snapshot_file for this snap is: volume-0699f44d-af5e-447e-a0d4-038bc0463316.6c0a2c00-1bcb-483f-905b-f96b5d149ffe {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[6970182b-309f-4944-80c8-8876bec302e3]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4aa8a1b8-f905-4490-95ff-e1dcd2d06fbc tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316.6c0a2c00-1bcb-483f-905b-f96b5d149ffe {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Flow 'volume_create_manager' (04b6e737-21ca-4713-aec6-d2b04262baba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9ff296f-540d-4ab7-b5f5-d4ff3b8e3c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9ff296f-540d-4ab7-b5f5-d4ff3b8e3c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1062905338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1175bbbb-8bab-4a0a-9843-4c473b8eb0a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72fc00fd27ed4e888de2adc238b18bb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:41:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:41:09Z,use_quota=True,user_id='e7a8728c9b46414291536bacd5cada26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177b17f5-d260-4f5a-8403-119acc840431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177b17f5-d260-4f5a-8403-119acc840431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:08 devstack sudo[89414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316.6c0a2c00-1bcb-483f-905b-f96b5d149ffe Apr 29 06:41:08 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abd04375-5ad3-45ba-b666-42fe8a6b0793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abd04375-5ad3-45ba-b666-42fe8a6b0793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1175bbbb-8bab-4a0a-9843-4c473b8eb0a0', 'volume_name': 'volume-1175bbbb-8bab-4a0a-9843-4c473b8eb0a0', 'volume_size': 2}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd633b6-89f9-4fad-b134-406937e34338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd633b6-89f9-4fad-b134-406937e34338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db097cb-c2d6-41ef-a998-324a96f400b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:08 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Volume 1175bbbb-8bab-4a0a-9843-4c473b8eb0a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1175bbbb-8bab-4a0a-9843-4c473b8eb0a0', 'volume_size': 2} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1062905338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1175bbbb-8bab-4a0a-9843-4c473b8eb0a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72fc00fd27ed4e888de2adc238b18bb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:41:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:41:09Z,use_quota=True,user_id='e7a8728c9b46414291536bacd5cada26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Creating volume 1175bbbb-8bab-4a0a-9843-4c473b8eb0a0 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:41:08 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:41:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1175bbbb-8bab-4a0a-9843-4c473b8eb0a0 2147483648 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:08 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1175bbbb-8bab-4a0a-9843-4c473b8eb0a0 2147483648 Apr 29 06:41:08 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:09 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:41:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Flow 'volume_create_manager' (95d52896-3659-4025-9cd0-c7d81cba95fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:41:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf2f15b-d197-4f61-99a8-a02e2770beb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf2f15b-d197-4f61-99a8-a02e2770beb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-209617204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=41d66f97-eb9d-4d83-a542-42c333f1ceab,host='devstack@QuobyteHD#QuobyteHD',id=ba5411ac-0ea5-4179-adcc-85d825e20579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d9e7b170394e1093075e88f3deb2fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:41:09Z,use_quota=True,user_id='5ebe735b9fb04d90a78dc3c973080675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51da38e9-6b1f-4bfd-b734-bd4e05f44561),volume_type_id=51da38e9-6b1f-4bfd-b734-bd4e05f44561)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4f380e5-63c4-4efc-a4f1-e4e99b096530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4f380e5-63c4-4efc-a4f1-e4e99b096530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3176cba8-90ba-429b-94ec-14ae19806b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3176cba8-90ba-429b-94ec-14ae19806b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba5411ac-0ea5-4179-adcc-85d825e20579', 'volume_name': 'volume-ba5411ac-0ea5-4179-adcc-85d825e20579', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6353374-4845-44ac-940f-95191277af59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6353374-4845-44ac-940f-95191277af59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (572e4a0d-f54f-49b0-8061-5b7873b58a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:09 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Volume ba5411ac-0ea5-4179-adcc-85d825e20579: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba5411ac-0ea5-4179-adcc-85d825e20579', 'volume_size': 1} Apr 29 06:41:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:09 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4aa8a1b8-f905-4490-95ff-e1dcd2d06fbc tempest-VolumesExtendTest-294590726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316.6c0a2c00-1bcb-483f-905b-f96b5d149ffe" returned: 0 in 0.988s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:09 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-4aa8a1b8-f905-4490-95ff-e1dcd2d06fbc tempest-VolumesExtendTest-294590726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0699f44d-af5e-447e-a0d4-038bc0463316(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:41:09 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccf2581-846d-4d5f-a978-11d6297673c0]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4aa8a1b8-f905-4490-95ff-e1dcd2d06fbc tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:09 devstack sudo[89428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316 Apr 29 06:41:09 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:10 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1175bbbb-8bab-4a0a-9843-4c473b8eb0a0 2147483648" returned: 0 in 1.038s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1175bbbb-8bab-4a0a-9843-4c473b8eb0a0 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:10 devstack sudo[89430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1175bbbb-8bab-4a0a-9843-4c473b8eb0a0 Apr 29 06:41:10 devstack sudo[89430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:10 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4aa8a1b8-f905-4490-95ff-e1dcd2d06fbc tempest-VolumesExtendTest-294590726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316" returned: 0 in 0.738s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4aa8a1b8-f905-4490-95ff-e1dcd2d06fbc tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316.6c0a2c00-1bcb-483f-905b-f96b5d149ffe {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:10 devstack sudo[89436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316.6c0a2c00-1bcb-483f-905b-f96b5d149ffe Apr 29 06:41:10 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:10 devstack sudo[89430]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1175bbbb-8bab-4a0a-9843-4c473b8eb0a0" returned: 0 in 0.636s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:10 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:41:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.362s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:10 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=41d66f97-eb9d-4d83-a542-42c333f1ceab,created_at=2026-04-29T04:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-209617204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=41d66f97-eb9d-4d83-a542-42c333f1ceab,host='devstack@QuobyteHD#QuobyteHD',id=ba5411ac-0ea5-4179-adcc-85d825e20579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d9e7b170394e1093075e88f3deb2fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:41:09Z,use_quota=True,user_id='5ebe735b9fb04d90a78dc3c973080675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51da38e9-6b1f-4bfd-b734-bd4e05f44561),volume_type_id=51da38e9-6b1f-4bfd-b734-bd4e05f44561)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:41:10 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Creating volume ba5411ac-0ea5-4179-adcc-85d825e20579 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:41:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:10 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:41:10 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:41:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:10 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:41:10 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:41:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db097cb-c2d6-41ef-a998-324a96f400b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1175bbbb-8bab-4a0a-9843-4c473b8eb0a0', 'volume_size': 2}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:10 devstack sudo[89438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579 1073741824 Apr 29 06:41:10 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7d535a-1dd3-4dbe-b3d7-e136375c29a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:10 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Volume volume-1175bbbb-8bab-4a0a-9843-4c473b8eb0a0 (1175bbbb-8bab-4a0a-9843-4c473b8eb0a0): created successfully Apr 29 06:41:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7d535a-1dd3-4dbe-b3d7-e136375c29a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Flow 'volume_create_manager' (04b6e737-21ca-4713-aec6-d2b04262baba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:41:10 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-f9cf7496-e313-4cb0-8fa6-bac520f474f1 tempest-VolumesCloneNegativeTest-1539413367 None] Created volume successfully. Apr 29 06:41:10 devstack cinder-volume[84195]: INFO cinder.volume.manager [req-ea08b247-472a-40a3-9748-669f1fd95bd5 req-40b2ddd2-e161-4cbd-a0eb-e4589295d6cb tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Terminate volume connection completed successfully. Apr 29 06:41:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [req-ea08b247-472a-40a3-9748-669f1fd95bd5 req-40b2ddd2-e161-4cbd-a0eb-e4589295d6cb tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Deleting attachment 3bc2fc20-1b25-4b5b-bbc0-fd177fa4b0a8. {{(pid=84195) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 06:41:11 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-828de972-65e1-4516-bf1f-e0b97a1d216c tempest-VolumesCloneNegativeTest-1539413367 None] Acquiring lock "cinder-1175bbbb-8bab-4a0a-9843-4c473b8eb0a0-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:11 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-828de972-65e1-4516-bf1f-e0b97a1d216c tempest-VolumesCloneNegativeTest-1539413367 None] Lock "cinder-1175bbbb-8bab-4a0a-9843-4c473b8eb0a0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:11 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-828de972-65e1-4516-bf1f-e0b97a1d216c tempest-VolumesCloneNegativeTest-1539413367 None] Acquiring lock "cinder-quobyte-1175bbbb-8bab-4a0a-9843-4c473b8eb0a0" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:11 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-828de972-65e1-4516-bf1f-e0b97a1d216c tempest-VolumesCloneNegativeTest-1539413367 None] Lock "cinder-quobyte-1175bbbb-8bab-4a0a-9843-4c473b8eb0a0" acquired by "delete_volume" :: waited 0.020s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:11 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c24f97-a6de-4884-b50b-b599f16dff16]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-828de972-65e1-4516-bf1f-e0b97a1d216c tempest-VolumesCloneNegativeTest-1539413367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1175bbbb-8bab-4a0a-9843-4c473b8eb0a0 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:11 devstack sudo[89444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1175bbbb-8bab-4a0a-9843-4c473b8eb0a0 Apr 29 06:41:11 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:11 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4aa8a1b8-f905-4490-95ff-e1dcd2d06fbc tempest-VolumesExtendTest-294590726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316.6c0a2c00-1bcb-483f-905b-f96b5d149ffe" returned: 0 in 0.835s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4aa8a1b8-f905-4490-95ff-e1dcd2d06fbc tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316.6c0a2c00-1bcb-483f-905b-f96b5d149ffe {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:11 devstack sudo[89449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316.6c0a2c00-1bcb-483f-905b-f96b5d149ffe Apr 29 06:41:11 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:11 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-ea08b247-472a-40a3-9748-669f1fd95bd5 req-63ef7be8-fc6d-4a5c-99e7-f394ae985154 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Acquiring lock "cinder-e9003718-43b6-4c4f-9d1c-8ef609d9d8a3-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:11 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-ea08b247-472a-40a3-9748-669f1fd95bd5 req-63ef7be8-fc6d-4a5c-99e7-f394ae985154 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Lock "cinder-e9003718-43b6-4c4f-9d1c-8ef609d9d8a3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:11 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-ea08b247-472a-40a3-9748-669f1fd95bd5 req-63ef7be8-fc6d-4a5c-99e7-f394ae985154 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Acquiring lock "cinder-quobyte-e9003718-43b6-4c4f-9d1c-8ef609d9d8a3" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:11 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-ea08b247-472a-40a3-9748-669f1fd95bd5 req-63ef7be8-fc6d-4a5c-99e7-f394ae985154 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Lock "cinder-quobyte-e9003718-43b6-4c4f-9d1c-8ef609d9d8a3" acquired by "delete_volume" :: waited 0.024s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:11 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf373947-c2f9-4830-8dad-0f68702911e8]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-ea08b247-472a-40a3-9748-669f1fd95bd5 req-63ef7be8-fc6d-4a5c-99e7-f394ae985154 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e9003718-43b6-4c4f-9d1c-8ef609d9d8a3 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:11 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579 1073741824" returned: 0 in 0.984s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:11 devstack sudo[89451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e9003718-43b6-4c4f-9d1c-8ef609d9d8a3 Apr 29 06:41:11 devstack sudo[89451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:11 devstack sudo[89452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579 Apr 29 06:41:11 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:12 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-828de972-65e1-4516-bf1f-e0b97a1d216c tempest-VolumesCloneNegativeTest-1539413367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1175bbbb-8bab-4a0a-9843-4c473b8eb0a0" returned: 0 in 0.905s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-828de972-65e1-4516-bf1f-e0b97a1d216c tempest-VolumesCloneNegativeTest-1539413367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1175bbbb-8bab-4a0a-9843-4c473b8eb0a0 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:12 devstack sudo[89460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1175bbbb-8bab-4a0a-9843-4c473b8eb0a0 Apr 29 06:41:12 devstack sudo[89460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:12 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4aa8a1b8-f905-4490-95ff-e1dcd2d06fbc tempest-VolumesExtendTest-294590726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316.6c0a2c00-1bcb-483f-905b-f96b5d149ffe" returned: 0 in 0.858s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:12 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4aa8a1b8-f905-4490-95ff-e1dcd2d06fbc tempest-VolumesExtendTest-294590726 None] Lock "cinder-quobyte-6c0a2c00-1bcb-483f-905b-f96b5d149ffe" released by "_delete_snapshot" :: held 3.570s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:12 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4aa8a1b8-f905-4490-95ff-e1dcd2d06fbc tempest-VolumesExtendTest-294590726 None] Lock "cinder-quobyte-0699f44d-af5e-447e-a0d4-038bc0463316" released by "delete_snapshot" :: held 3.626s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:12 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-4aa8a1b8-f905-4490-95ff-e1dcd2d06fbc tempest-VolumesExtendTest-294590726 None] Created reservations ['1ef8dee0-d87e-469e-8b90-6784994016dd', '4bfd65e8-e26c-44ad-b03b-bb563b98925a', 'ed7f8214-9a73-46d5-84c3-92f96075398a', 'edd04db4-8e1b-4dc1-aa34-06329ac4a1a6'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:41:12 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579" returned: 0 in 0.763s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:12 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:41:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:12 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (572e4a0d-f54f-49b0-8061-5b7873b58a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba5411ac-0ea5-4179-adcc-85d825e20579', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:12 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f100c51-da98-4b51-9dc4-6091b8e5363a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:12 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-4aa8a1b8-f905-4490-95ff-e1dcd2d06fbc tempest-VolumesExtendTest-294590726 None] Delete snapshot completed successfully. Apr 29 06:41:12 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Volume volume-ba5411ac-0ea5-4179-adcc-85d825e20579 (ba5411ac-0ea5-4179-adcc-85d825e20579): created successfully Apr 29 06:41:12 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f100c51-da98-4b51-9dc4-6091b8e5363a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:12 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Flow 'volume_create_manager' (95d52896-3659-4025-9cd0-c7d81cba95fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:41:12 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4aa8a1b8-f905-4490-95ff-e1dcd2d06fbc tempest-VolumesExtendTest-294590726 None] Lock "cinder-6c0a2c00-1bcb-483f-905b-f96b5d149ffe-delete_snapshot" released by "delete_snapshot" :: held 3.865s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:12 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-5cb358fd-8508-47fd-a9a8-d87dfe09f9d8 tempest-GroupSnapshotsTest-841847317 None] Created volume successfully. Apr 29 06:41:12 devstack sudo[89451]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-ea08b247-472a-40a3-9748-669f1fd95bd5 req-63ef7be8-fc6d-4a5c-99e7-f394ae985154 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e9003718-43b6-4c4f-9d1c-8ef609d9d8a3" returned: 0 in 0.955s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-ea08b247-472a-40a3-9748-669f1fd95bd5 req-63ef7be8-fc6d-4a5c-99e7-f394ae985154 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e9003718-43b6-4c4f-9d1c-8ef609d9d8a3 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:12 devstack sudo[89467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e9003718-43b6-4c4f-9d1c-8ef609d9d8a3 Apr 29 06:41:12 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:12 devstack sudo[89460]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-828de972-65e1-4516-bf1f-e0b97a1d216c tempest-VolumesCloneNegativeTest-1539413367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1175bbbb-8bab-4a0a-9843-4c473b8eb0a0" returned: 0 in 0.715s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:12 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-828de972-65e1-4516-bf1f-e0b97a1d216c tempest-VolumesCloneNegativeTest-1539413367 None] Lock "cinder-quobyte-1175bbbb-8bab-4a0a-9843-4c473b8eb0a0" released by "delete_volume" :: held 1.668s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:12 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-c589298d-5978-4f49-9495-569660bc81ac tempest-GroupSnapshotsTest-841847317 None] GroupSnapshot bd29b9b9-848f-4c26-a0f6-26dfae1f38e4: creating. Apr 29 06:41:12 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c589298d-5978-4f49-9495-569660bc81ac tempest-GroupSnapshotsTest-841847317 None] Group snapshot bd29b9b9-848f-4c26-a0f6-26dfae1f38e4: creating. {{(pid=84195) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 06:41:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c589298d-5978-4f49-9495-569660bc81ac tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c589298d-5978-4f49-9495-569660bc81ac tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:12 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-c589298d-5978-4f49-9495-569660bc81ac tempest-GroupSnapshotsTest-841847317 None] Creating offline snapshot a37d3b42-0773-4350-838c-42b9fb98087b of volume ba5411ac-0ea5-4179-adcc-85d825e20579 {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:41:12 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-828de972-65e1-4516-bf1f-e0b97a1d216c tempest-VolumesCloneNegativeTest-1539413367 None] Created reservations ['2de3b96d-55d6-4509-9aa7-fc1637950f0c', 'a4beb03c-1e41-404d-815c-565d35fe3d2c', 'de40cb01-5ad0-4a18-9446-ddeab74eb618', '2d6aca6c-6e91-4f81-9c40-0583d8c18223'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:41:13 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[39317785-9a24-4f65-9646-0fac3c00aa1b]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c589298d-5978-4f49-9495-569660bc81ac tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:13 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1a1caca0-289f-4bc7-8ffe-6f59703355c7 tempest-VolumesExtendTest-294590726 None] Acquiring lock "cinder-0699f44d-af5e-447e-a0d4-038bc0463316-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-828de972-65e1-4516-bf1f-e0b97a1d216c tempest-VolumesCloneNegativeTest-1539413367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-828de972-65e1-4516-bf1f-e0b97a1d216c tempest-VolumesCloneNegativeTest-1539413367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:13 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-828de972-65e1-4516-bf1f-e0b97a1d216c tempest-VolumesCloneNegativeTest-1539413367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:41:13 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-828de972-65e1-4516-bf1f-e0b97a1d216c tempest-VolumesCloneNegativeTest-1539413367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:41:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-828de972-65e1-4516-bf1f-e0b97a1d216c tempest-VolumesCloneNegativeTest-1539413367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-828de972-65e1-4516-bf1f-e0b97a1d216c tempest-VolumesCloneNegativeTest-1539413367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:13 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1a1caca0-289f-4bc7-8ffe-6f59703355c7 tempest-VolumesExtendTest-294590726 None] Lock "cinder-0699f44d-af5e-447e-a0d4-038bc0463316-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:13 devstack sudo[89471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:41:13 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:13 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1a1caca0-289f-4bc7-8ffe-6f59703355c7 tempest-VolumesExtendTest-294590726 None] Acquiring lock "cinder-quobyte-0699f44d-af5e-447e-a0d4-038bc0463316" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:13 devstack sudo[89470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579 Apr 29 06:41:13 devstack sudo[89470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:13 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1a1caca0-289f-4bc7-8ffe-6f59703355c7 tempest-VolumesExtendTest-294590726 None] Lock "cinder-quobyte-0699f44d-af5e-447e-a0d4-038bc0463316" acquired by "delete_volume" :: waited 0.023s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:13 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-ea08b247-472a-40a3-9748-669f1fd95bd5 req-63ef7be8-fc6d-4a5c-99e7-f394ae985154 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e9003718-43b6-4c4f-9d1c-8ef609d9d8a3" returned: 0 in 0.684s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:13 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7b4e46-be68-4949-b40a-6f904c527c48]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1a1caca0-289f-4bc7-8ffe-6f59703355c7 tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:13 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-ea08b247-472a-40a3-9748-669f1fd95bd5 req-63ef7be8-fc6d-4a5c-99e7-f394ae985154 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Lock "cinder-quobyte-e9003718-43b6-4c4f-9d1c-8ef609d9d8a3" released by "delete_volume" :: held 1.731s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:13 devstack cinder-volume[84195]: DEBUG cinder.quota [req-ea08b247-472a-40a3-9748-669f1fd95bd5 req-63ef7be8-fc6d-4a5c-99e7-f394ae985154 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Created reservations ['0628038d-b38b-4596-ac41-6e039213f7fe', '94aa3f7b-b20d-47cb-8a76-ff9d1be96213', '44bd5317-721f-4b32-a63e-131834a2bc60', 'd23ad738-6423-4dc5-906e-47db8e60b718'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:41:13 devstack sudo[89475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316 Apr 29 06:41:13 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-ea08b247-472a-40a3-9748-669f1fd95bd5 req-63ef7be8-fc6d-4a5c-99e7-f394ae985154 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-ea08b247-472a-40a3-9748-669f1fd95bd5 req-63ef7be8-fc6d-4a5c-99e7-f394ae985154 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:13 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [req-ea08b247-472a-40a3-9748-669f1fd95bd5 req-63ef7be8-fc6d-4a5c-99e7-f394ae985154 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:41:13 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [req-ea08b247-472a-40a3-9748-669f1fd95bd5 req-63ef7be8-fc6d-4a5c-99e7-f394ae985154 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:41:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [req-ea08b247-472a-40a3-9748-669f1fd95bd5 req-63ef7be8-fc6d-4a5c-99e7-f394ae985154 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-ea08b247-472a-40a3-9748-669f1fd95bd5 req-63ef7be8-fc6d-4a5c-99e7-f394ae985154 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:13 devstack sudo[89477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:41:13 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:14 devstack sudo[89470]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c589298d-5978-4f49-9495-569660bc81ac tempest-GroupSnapshotsTest-841847317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579" returned: 0 in 1.025s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c589298d-5978-4f49-9495-569660bc81ac tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.a37d3b42-0773-4350-838c-42b9fb98087b 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:14 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.a37d3b42-0773-4350-838c-42b9fb98087b 1G Apr 29 06:41:14 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:14 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-828de972-65e1-4516-bf1f-e0b97a1d216c tempest-VolumesCloneNegativeTest-1539413367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 1.010s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:14 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-828de972-65e1-4516-bf1f-e0b97a1d216c tempest-VolumesCloneNegativeTest-1539413367 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:41:14 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-828de972-65e1-4516-bf1f-e0b97a1d216c tempest-VolumesCloneNegativeTest-1539413367 None] Deleted volume successfully. Apr 29 06:41:14 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-828de972-65e1-4516-bf1f-e0b97a1d216c tempest-VolumesCloneNegativeTest-1539413367 None] Lock "cinder-1175bbbb-8bab-4a0a-9843-4c473b8eb0a0-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:14 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1a1caca0-289f-4bc7-8ffe-6f59703355c7 tempest-VolumesExtendTest-294590726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316" returned: 0 in 1.102s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1a1caca0-289f-4bc7-8ffe-6f59703355c7 tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:14 devstack sudo[89488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316 Apr 29 06:41:14 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:14 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [req-ea08b247-472a-40a3-9748-669f1fd95bd5 req-63ef7be8-fc6d-4a5c-99e7-f394ae985154 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.982s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:14 devstack cinder-volume[84195]: DEBUG cinder.manager [req-ea08b247-472a-40a3-9748-669f1fd95bd5 req-63ef7be8-fc6d-4a5c-99e7-f394ae985154 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:41:14 devstack cinder-volume[84195]: INFO cinder.volume.manager [req-ea08b247-472a-40a3-9748-669f1fd95bd5 req-63ef7be8-fc6d-4a5c-99e7-f394ae985154 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Deleted volume successfully. Apr 29 06:41:14 devstack cinder-volume[84195]: DEBUG cinder.coordination [req-ea08b247-472a-40a3-9748-669f1fd95bd5 req-63ef7be8-fc6d-4a5c-99e7-f394ae985154 tempest-ServerBootFromVolumeStableRescueTest-1698210963 None] Lock "cinder-e9003718-43b6-4c4f-9d1c-8ef609d9d8a3-delete_volume" released by "delete_volume" :: held 3.107s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:15 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c589298d-5978-4f49-9495-569660bc81ac tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.a37d3b42-0773-4350-838c-42b9fb98087b 1G" returned: 0 in 1.150s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c589298d-5978-4f49-9495-569660bc81ac tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba5411ac-0ea5-4179-adcc-85d825e20579 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.a37d3b42-0773-4350-838c-42b9fb98087b {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:15 devstack sudo[89497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba5411ac-0ea5-4179-adcc-85d825e20579 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.a37d3b42-0773-4350-838c-42b9fb98087b Apr 29 06:41:15 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:15 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1a1caca0-289f-4bc7-8ffe-6f59703355c7 tempest-VolumesExtendTest-294590726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0699f44d-af5e-447e-a0d4-038bc0463316" returned: 0 in 0.858s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:15 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1a1caca0-289f-4bc7-8ffe-6f59703355c7 tempest-VolumesExtendTest-294590726 None] Lock "cinder-quobyte-0699f44d-af5e-447e-a0d4-038bc0463316" released by "delete_volume" :: held 2.082s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:15 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:INSERT=50,cinder:SELECT=125,cinder:UPDATE=155,cinder:DELETE=13 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:41:15 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-1a1caca0-289f-4bc7-8ffe-6f59703355c7 tempest-VolumesExtendTest-294590726 None] Created reservations ['c171f729-b772-4f0c-ba57-973f2d01cd1d', '0717d0a9-5a43-4392-a58d-4dcb6cc8e24e', '013ece30-d970-418c-9ca8-4ade0f8cacd6', '5ba69bf2-b1db-465c-aec9-80b4b0fb7fdb'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:41:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1a1caca0-289f-4bc7-8ffe-6f59703355c7 tempest-VolumesExtendTest-294590726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1a1caca0-289f-4bc7-8ffe-6f59703355c7 tempest-VolumesExtendTest-294590726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:15 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1a1caca0-289f-4bc7-8ffe-6f59703355c7 tempest-VolumesExtendTest-294590726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:41:15 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1a1caca0-289f-4bc7-8ffe-6f59703355c7 tempest-VolumesExtendTest-294590726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:41:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1a1caca0-289f-4bc7-8ffe-6f59703355c7 tempest-VolumesExtendTest-294590726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1a1caca0-289f-4bc7-8ffe-6f59703355c7 tempest-VolumesExtendTest-294590726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:15 devstack sudo[89499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:41:15 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:16 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c589298d-5978-4f49-9495-569660bc81ac tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba5411ac-0ea5-4179-adcc-85d825e20579 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.a37d3b42-0773-4350-838c-42b9fb98087b" returned: 0 in 0.840s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:16 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-c589298d-5978-4f49-9495-569660bc81ac tempest-GroupSnapshotsTest-841847317 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.a37d3b42-0773-4350-838c-42b9fb98087b is being set with open permissions: ugo+rw: NotImplementedError Apr 29 06:41:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c589298d-5978-4f49-9495-569660bc81ac tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.a37d3b42-0773-4350-838c-42b9fb98087b {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:16 devstack sudo[89506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.a37d3b42-0773-4350-838c-42b9fb98087b Apr 29 06:41:16 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:16 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1a1caca0-289f-4bc7-8ffe-6f59703355c7 tempest-VolumesExtendTest-294590726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.670s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:16 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-1a1caca0-289f-4bc7-8ffe-6f59703355c7 tempest-VolumesExtendTest-294590726 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:41:16 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-1a1caca0-289f-4bc7-8ffe-6f59703355c7 tempest-VolumesExtendTest-294590726 None] Deleted volume successfully. Apr 29 06:41:16 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1a1caca0-289f-4bc7-8ffe-6f59703355c7 tempest-VolumesExtendTest-294590726 None] Lock "cinder-0699f44d-af5e-447e-a0d4-038bc0463316-delete_volume" released by "delete_volume" :: held 3.061s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:16 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c589298d-5978-4f49-9495-569660bc81ac tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.a37d3b42-0773-4350-838c-42b9fb98087b" returned: 0 in 0.896s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:16 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:SELECT=120,cinder:UPDATE=141,cinder:INSERT=38,cinder:DELETE=11 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:41:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c589298d-5978-4f49-9495-569660bc81ac tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:17 devstack sudo[89554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.info Apr 29 06:41:17 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:17 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:41:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Flow 'volume_create_manager' (7ef8a001-3ee7-4c21-a2ee-bdcdb230f04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:41:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df3a167-0dae-4a3e-9d54-20e2b87ecbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df3a167-0dae-4a3e-9d54-20e2b87ecbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-102908805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b9e834-1a53-4048-a4df-71e13c1ea90c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdfa1e50e94541aa8b666cb52758fdd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:41:18Z,use_quota=True,user_id='678afd14c9ca4c8eb46680b04d76680e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8310a5-dcd8-4e77-ba05-e96712509aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8310a5-dcd8-4e77-ba05-e96712509aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a90d7a3-49c7-4f6c-9c21-b8c83e92d150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a90d7a3-49c7-4f6c-9c21-b8c83e92d150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7b9e834-1a53-4048-a4df-71e13c1ea90c', 'volume_name': 'volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dfdf1b2-9a26-47ec-a1c8-5655e2076f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dfdf1b2-9a26-47ec-a1c8-5655e2076f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee8cb64-95b3-4da3-8d3f-4a5c6aef6cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:17 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Volume c7b9e834-1a53-4048-a4df-71e13c1ea90c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c', 'volume_size': 1} Apr 29 06:41:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:17 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c589298d-5978-4f49-9495-569660bc81ac tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.info" returned: 0 in 0.971s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:17 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-c589298d-5978-4f49-9495-569660bc81ac tempest-GroupSnapshotsTest-841847317 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 06:41:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c589298d-5978-4f49-9495-569660bc81ac tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:17 devstack sudo[89561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.info Apr 29 06:41:17 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:18 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c589298d-5978-4f49-9495-569660bc81ac tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.info" returned: 0 in 0.726s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c589298d-5978-4f49-9495-569660bc81ac tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.747s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.778s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-102908805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b9e834-1a53-4048-a4df-71e13c1ea90c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdfa1e50e94541aa8b666cb52758fdd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:41:18Z,use_quota=True,user_id='678afd14c9ca4c8eb46680b04d76680e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:41:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Creating volume c7b9e834-1a53-4048-a4df-71e13c1ea90c {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:41:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:41:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:41:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:41:18 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:41:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:18 devstack sudo[89565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c 1073741824 Apr 29 06:41:18 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:18 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-c589298d-5978-4f49-9495-569660bc81ac tempest-GroupSnapshotsTest-841847317 None] group_snapshot bd29b9b9-848f-4c26-a0f6-26dfae1f38e4: created successfully Apr 29 06:41:19 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c 1073741824" returned: 0 in 0.956s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:19 devstack sudo[89571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c Apr 29 06:41:19 devstack sudo[89571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Flow 'volume_create_manager' (dd59a282-f753-4894-997e-66407b415bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac98d26-f134-4916-ac64-cc641fedc8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac98d26-f134-4916-ac64-cc641fedc8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-342664658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a18d5f9-fa4e-491c-833a-dc80af5e62c9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='de093ceebc784c93b0b02e0c89978247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:41:20Z,use_quota=True,user_id='46456f53c8ca414a88ce4258a59158ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae924176-814a-4530-8bc2-0f5983ba2494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae924176-814a-4530-8bc2-0f5983ba2494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455b7c83-7c26-49a6-8585-990635f2c4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455b7c83-7c26-49a6-8585-990635f2c4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a18d5f9-fa4e-491c-833a-dc80af5e62c9', 'volume_name': 'volume-9a18d5f9-fa4e-491c-833a-dc80af5e62c9', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e9cfb92-a714-46d9-a533-e9e8e98e4178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e9cfb92-a714-46d9-a533-e9e8e98e4178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ebda636-5f41-4fc8-a893-2a6453b27621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:20 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Volume 9a18d5f9-fa4e-491c-833a-dc80af5e62c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a18d5f9-fa4e-491c-833a-dc80af5e62c9', 'volume_size': 1} Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:20 devstack sudo[89571]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c" returned: 0 in 0.620s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.082s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-342664658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a18d5f9-fa4e-491c-833a-dc80af5e62c9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='de093ceebc784c93b0b02e0c89978247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:41:20Z,use_quota=True,user_id='46456f53c8ca414a88ce4258a59158ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Creating volume 9a18d5f9-fa4e-491c-833a-dc80af5e62c9 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:41:20 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9a18d5f9-fa4e-491c-833a-dc80af5e62c9 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee8cb64-95b3-4da3-8d3f-4a5c6aef6cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:20 devstack sudo[89574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9a18d5f9-fa4e-491c-833a-dc80af5e62c9 1073741824 Apr 29 06:41:20 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15c9d361-b9d5-437f-a959-faa9e1f5c025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:20 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Volume volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c (c7b9e834-1a53-4048-a4df-71e13c1ea90c): created successfully Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15c9d361-b9d5-437f-a959-faa9e1f5c025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Flow 'volume_create_manager' (7ef8a001-3ee7-4c21-a2ee-bdcdb230f04c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:41:20 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-86d87512-6a2c-4119-9971-4a14a7461e37 tempest-VolumesSnapshotListTestJSON-1992088123 None] Created volume successfully. Apr 29 06:41:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:21 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9a18d5f9-fa4e-491c-833a-dc80af5e62c9 1073741824" returned: 0 in 0.804s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9a18d5f9-fa4e-491c-833a-dc80af5e62c9 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:21 devstack sudo[89579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9a18d5f9-fa4e-491c-833a-dc80af5e62c9 Apr 29 06:41:21 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-be597411-dd69-4b13-a03c-9361c34c4eb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:21 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9a18d5f9-fa4e-491c-833a-dc80af5e62c9" returned: 0 in 0.635s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.362s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "cinder-quobyte-a37d3b42-0773-4350-838c-42b9fb98087b-7dbee389-5123-428f-b95a-444a63ab509a" by "_create_volume_from_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ebda636-5f41-4fc8-a893-2a6453b27621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a18d5f9-fa4e-491c-833a-dc80af5e62c9', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7d55e8-ffe5-4ddb-9d90-70ca2c143a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-a37d3b42-0773-4350-838c-42b9fb98087b-7dbee389-5123-428f-b95a-444a63ab509a" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Creating volume 7dbee389-5123-428f-b95a-444a63ab509a from snapshot a37d3b42-0773-4350-838c-42b9fb98087b {{(pid=84195) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "cinder-quobyte-7dbee389-5123-428f-b95a-444a63ab509a" by "_copy_volume_from_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:21 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Volume volume-9a18d5f9-fa4e-491c-833a-dc80af5e62c9 (9a18d5f9-fa4e-491c-833a-dc80af5e62c9): created successfully Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7d55e8-ffe5-4ddb-9d90-70ca2c143a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Flow 'volume_create_manager' (dd59a282-f753-4894-997e-66407b415bcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-7dbee389-5123-428f-b95a-444a63ab509a" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] snapshot: a37d3b42-0773-4350-838c-42b9fb98087b, volume: 7dbee389-5123-428f-b95a-444a63ab509a, {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 06:41:21 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-76b2168f-28c7-4cb3-a698-32ddf466e7ab tempest-VolumesGetTest-1294989752 None] Created volume successfully. Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2249503-434e-4243-8493-3fb75e696bdc]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.a37d3b42-0773-4350-838c-42b9fb98087b {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:22 devstack sudo[89590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.a37d3b42-0773-4350-838c-42b9fb98087b Apr 29 06:41:22 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:22 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.a37d3b42-0773-4350-838c-42b9fb98087b" returned: 0 in 1.005s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba5411ac-0ea5-4179-adcc-85d825e20579(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:41:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579 {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 06:41:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Creating direct copy from snapshot {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 06:41:23 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ac68f5-f3f3-4d11-be77-d3d8797fd048]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:23 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:41:23 devstack sudo[89623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579 Apr 29 06:41:23 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:23 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Flow 'volume_create_manager' (e54830df-7219-410d-a1c4-1a4e7c31835f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:41:23 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8dc1c98-94aa-4a23-9c36-21db8803db0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:23 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8dc1c98-94aa-4a23-9c36-21db8803db0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:41:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2035140284',display_name='tempest-VolumesGetTest-Volume-1546030192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=339235a8-f374-475a-b4e7-c2b90d0c2b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de093ceebc784c93b0b02e0c89978247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:41:23Z,use_quota=True,user_id='46456f53c8ca414a88ce4258a59158ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:23 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f6f6286-e21b-4a01-96b6-58504d031eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:23 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f6f6286-e21b-4a01-96b6-58504d031eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:23 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5055a69-2344-4913-ba19-6ece857186a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:23 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5055a69-2344-4913-ba19-6ece857186a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '339235a8-f374-475a-b4e7-c2b90d0c2b6f', 'volume_name': 'volume-339235a8-f374-475a-b4e7-c2b90d0c2b6f', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:23 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89956e51-9a93-4eaa-9af0-ebc64462c91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:23 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89956e51-9a93-4eaa-9af0-ebc64462c91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:23 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b750aaa-183d-40aa-9237-0b780d2e26ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:23 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Volume 339235a8-f374-475a-b4e7-c2b90d0c2b6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-339235a8-f374-475a-b4e7-c2b90d0c2b6f', 'volume_size': 1} Apr 29 06:41:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:23 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579" returned: 0 in 0.814s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:23 devstack cinder-volume[84195]: DEBUG cinder.utils [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Path /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7dbee389-5123-428f-b95a-444a63ab509a not found in is_blk_device check {{(pid=84195) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 06:41:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7dbee389-5123-428f-b95a-444a63ab509a {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:23 devstack sudo[89629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7dbee389-5123-428f-b95a-444a63ab509a Apr 29 06:41:23 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:29 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7dbee389-5123-428f-b95a-444a63ab509a" returned: 0 in 5.598s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:29 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb09917a-6cb0-4bec-983f-bb69c3033149]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:29 devstack sudo[89644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579 Apr 29 06:41:29 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:30 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579" returned: 0 in 0.926s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:30 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Image conversion details: src /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7dbee389-5123-428f-b95a-444a63ab509a {{(pid=84195) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 06:41:30 devstack cinder-volume[84195]: INFO cinder.image.image_utils [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Converted 1024.00 MB image at 182.88 MB/s Apr 29 06:41:30 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7dbee389-5123-428f-b95a-444a63ab509a is being set with open permissions: ugo+rw: NotImplementedError Apr 29 06:41:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7dbee389-5123-428f-b95a-444a63ab509a {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:30 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7dbee389-5123-428f-b95a-444a63ab509a Apr 29 06:41:30 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:31 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7dbee389-5123-428f-b95a-444a63ab509a" returned: 0 in 0.628s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:31 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-7dbee389-5123-428f-b95a-444a63ab509a" released by "_copy_volume_from_snapshot" :: held 9.110s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:31 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-a37d3b42-0773-4350-838c-42b9fb98087b-7dbee389-5123-428f-b95a-444a63ab509a" released by "_create_volume_from_snapshot" :: held 9.156s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.187s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-be597411-dd69-4b13-a03c-9361c34c4eb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.665s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:31 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-be597411-dd69-4b13-a03c-9361c34c4eb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Creating offline snapshot 341d061b-db6d-476f-b9f8-d9dc69642e96 of volume c7b9e834-1a53-4048-a4df-71e13c1ea90c {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:41:31 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ec196c-7afa-4217-b9f3-79793be6cd9b]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-be597411-dd69-4b13-a03c-9361c34c4eb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:31 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-40320fc4-fcbf-4367-ada2-2afe8bf4809d tempest-GroupSnapshotsTest-841847317 None] Create group from source-snapshot-bd29b9b9-848f-4c26-a0f6-26dfae1f38e4 completed successfully. Apr 29 06:41:31 devstack sudo[89652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c Apr 29 06:41:31 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:31 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:41:31 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Flow 'volume_create_manager' (8d12d7f9-e6c8-4a0c-8ad7-f780e90a5599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:41:31 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5493c163-7f4e-4d93-97a5-ac6cc8e5ca0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:31 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5493c163-7f4e-4d93-97a5-ac6cc8e5ca0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-67240882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1f3f81-fbfe-4fba-b2fb-55e70140a7e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2c9f889c40b846a789111ea84729b4ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:41:32Z,use_quota=True,user_id='8286f9c86b3948579480102c5e32f587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:31 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eadc1ab0-6986-433d-bf24-0e40cf4ebab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:31 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eadc1ab0-6986-433d-bf24-0e40cf4ebab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:31 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1bb42b8-546a-48bb-a700-df9d141a68a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:31 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1bb42b8-546a-48bb-a700-df9d141a68a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f1f3f81-fbfe-4fba-b2fb-55e70140a7e5', 'volume_name': 'volume-2f1f3f81-fbfe-4fba-b2fb-55e70140a7e5', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:31 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (857cf158-fd8b-4bdc-a893-df92bad39084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:31 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (857cf158-fd8b-4bdc-a893-df92bad39084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:31 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e56407-f2db-453e-976e-ec416802f88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:31 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Volume 2f1f3f81-fbfe-4fba-b2fb-55e70140a7e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f1f3f81-fbfe-4fba-b2fb-55e70140a7e5', 'volume_size': 1} Apr 29 06:41:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:31 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-be597411-dd69-4b13-a03c-9361c34c4eb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c" returned: 0 in 0.743s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-be597411-dd69-4b13-a03c-9361c34c4eb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:31 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96 1G Apr 29 06:41:31 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:32 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-be597411-dd69-4b13-a03c-9361c34c4eb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96 1G" returned: 0 in 0.823s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-be597411-dd69-4b13-a03c-9361c34c4eb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:32 devstack sudo[89670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96 Apr 29 06:41:32 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:32 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7b03411c-7110-41c8-8291-f08e86ed91f4 tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "cinder-quobyte-7dbee389-5123-428f-b95a-444a63ab509a" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:32 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7b03411c-7110-41c8-8291-f08e86ed91f4 tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-7dbee389-5123-428f-b95a-444a63ab509a" acquired by "delete_volume" :: waited 0.021s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:32 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ae038d-33dd-4a55-b37f-baa7ca929c82]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7b03411c-7110-41c8-8291-f08e86ed91f4 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7dbee389-5123-428f-b95a-444a63ab509a {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:32 devstack sudo[89672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7dbee389-5123-428f-b95a-444a63ab509a Apr 29 06:41:32 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:33 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-be597411-dd69-4b13-a03c-9361c34c4eb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96" returned: 0 in 0.679s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:33 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-be597411-dd69-4b13-a03c-9361c34c4eb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96 is being set with open permissions: ugo+rw Apr 29 06:41:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-be597411-dd69-4b13-a03c-9361c34c4eb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:33 devstack sudo[89677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96 Apr 29 06:41:33 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:33 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7b03411c-7110-41c8-8291-f08e86ed91f4 tempest-GroupSnapshotsTest-841847317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7dbee389-5123-428f-b95a-444a63ab509a" returned: 0 in 0.758s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7b03411c-7110-41c8-8291-f08e86ed91f4 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7dbee389-5123-428f-b95a-444a63ab509a {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:33 devstack sudo[89682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7dbee389-5123-428f-b95a-444a63ab509a Apr 29 06:41:33 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:33 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-be597411-dd69-4b13-a03c-9361c34c4eb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96" returned: 0 in 0.603s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-be597411-dd69-4b13-a03c-9361c34c4eb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:34 devstack sudo[89685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.info Apr 29 06:41:34 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:34 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7b03411c-7110-41c8-8291-f08e86ed91f4 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7dbee389-5123-428f-b95a-444a63ab509a" returned: 0 in 0.617s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:34 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7b03411c-7110-41c8-8291-f08e86ed91f4 tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-7dbee389-5123-428f-b95a-444a63ab509a" released by "delete_volume" :: held 1.438s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:34 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-7b03411c-7110-41c8-8291-f08e86ed91f4 tempest-GroupSnapshotsTest-841847317 None] Created reservations ['33a72ba9-9bca-464e-86fb-aaf7e938cb3a'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:41:34 devstack cinder-volume[84195]: WARNING cinder.quota [None req-7b03411c-7110-41c8-8291-f08e86ed91f4 tempest-GroupSnapshotsTest-841847317 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-278564052 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-278564052, it is now deprecated. Please use the default quota class for default quota. Apr 29 06:41:34 devstack cinder-volume[84195]: WARNING cinder.quota [None req-7b03411c-7110-41c8-8291-f08e86ed91f4 tempest-GroupSnapshotsTest-841847317 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-278564052 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-278564052, it is now deprecated. Please use the default quota class for default quota. Apr 29 06:41:34 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-7b03411c-7110-41c8-8291-f08e86ed91f4 tempest-GroupSnapshotsTest-841847317 None] Created reservations ['159d8738-bf18-4137-b3c8-7a761e447ca8', '126e2d63-97a0-4955-96e9-75bcad1ab915', 'be3e602b-d52a-460a-a496-64b326c356b4', '4db88e1e-5642-444d-af04-b0e048b1dff1'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:41:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7b03411c-7110-41c8-8291-f08e86ed91f4 tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7b03411c-7110-41c8-8291-f08e86ed91f4 tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-7b03411c-7110-41c8-8291-f08e86ed91f4 tempest-GroupSnapshotsTest-841847317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:41:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-7b03411c-7110-41c8-8291-f08e86ed91f4 tempest-GroupSnapshotsTest-841847317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:41:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7b03411c-7110-41c8-8291-f08e86ed91f4 tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7b03411c-7110-41c8-8291-f08e86ed91f4 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:34 devstack sudo[89688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:41:34 devstack sudo[89688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:34 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-be597411-dd69-4b13-a03c-9361c34c4eb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.info" returned: 0 in 0.615s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:34 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-be597411-dd69-4b13-a03c-9361c34c4eb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.info is being set with open permissions: ugo+rw Apr 29 06:41:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-be597411-dd69-4b13-a03c-9361c34c4eb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:34 devstack sudo[89693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.info Apr 29 06:41:34 devstack sudo[89693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:34 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-5453d83a-83a8-4327-8b16-327add9dffa3 tempest-GroupSnapshotsTest-841847317 None] group_snapshot bd29b9b9-848f-4c26-a0f6-26dfae1f38e4: deleting Apr 29 06:41:34 devstack sudo[89688]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7b03411c-7110-41c8-8291-f08e86ed91f4 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.628s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:35 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-7b03411c-7110-41c8-8291-f08e86ed91f4 tempest-GroupSnapshotsTest-841847317 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:41:35 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-7b03411c-7110-41c8-8291-f08e86ed91f4 tempest-GroupSnapshotsTest-841847317 None] Delete group completed successfully. Apr 29 06:41:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5453d83a-83a8-4327-8b16-327add9dffa3 tempest-GroupSnapshotsTest-841847317 None] group_snapshot bd29b9b9-848f-4c26-a0f6-26dfae1f38e4: deleting {{(pid=84195) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 06:41:35 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5453d83a-83a8-4327-8b16-327add9dffa3 tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "cinder-quobyte-ba5411ac-0ea5-4179-adcc-85d825e20579" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:35 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5453d83a-83a8-4327-8b16-327add9dffa3 tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-ba5411ac-0ea5-4179-adcc-85d825e20579" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:35 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5453d83a-83a8-4327-8b16-327add9dffa3 tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "cinder-quobyte-a37d3b42-0773-4350-838c-42b9fb98087b" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:35 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5453d83a-83a8-4327-8b16-327add9dffa3 tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-a37d3b42-0773-4350-838c-42b9fb98087b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-5453d83a-83a8-4327-8b16-327add9dffa3 tempest-GroupSnapshotsTest-841847317 None] Deleting offline snapshot a37d3b42-0773-4350-838c-42b9fb98087b of volume ba5411ac-0ea5-4179-adcc-85d825e20579 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:41:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-5453d83a-83a8-4327-8b16-327add9dffa3 tempest-GroupSnapshotsTest-841847317 None] snapshot_file for this snap is: volume-ba5411ac-0ea5-4179-adcc-85d825e20579.a37d3b42-0773-4350-838c-42b9fb98087b {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:41:35 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ee649f-c869-4612-803f-f7e5318730e1]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5453d83a-83a8-4327-8b16-327add9dffa3 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.a37d3b42-0773-4350-838c-42b9fb98087b {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:35 devstack sudo[89693]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-be597411-dd69-4b13-a03c-9361c34c4eb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.info" returned: 0 in 0.617s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-be597411-dd69-4b13-a03c-9361c34c4eb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.190s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.012s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:41:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2035140284',display_name='tempest-VolumesGetTest-Volume-1546030192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=339235a8-f374-475a-b4e7-c2b90d0c2b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de093ceebc784c93b0b02e0c89978247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:41:23Z,use_quota=True,user_id='46456f53c8ca414a88ce4258a59158ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:41:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Creating volume 339235a8-f374-475a-b4e7-c2b90d0c2b6f {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:41:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:41:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:41:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:41:35 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:41:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-339235a8-f374-475a-b4e7-c2b90d0c2b6f 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:35 devstack sudo[89698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-339235a8-f374-475a-b4e7-c2b90d0c2b6f 1073741824 Apr 29 06:41:35 devstack sudo[89698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:35 devstack sudo[89697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.a37d3b42-0773-4350-838c-42b9fb98087b Apr 29 06:41:35 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:35 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-be597411-dd69-4b13-a03c-9361c34c4eb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Create snapshot completed successfully Apr 29 06:41:35 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5453d83a-83a8-4327-8b16-327add9dffa3 tempest-GroupSnapshotsTest-841847317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.a37d3b42-0773-4350-838c-42b9fb98087b" returned: 0 in 0.741s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-5453d83a-83a8-4327-8b16-327add9dffa3 tempest-GroupSnapshotsTest-841847317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba5411ac-0ea5-4179-adcc-85d825e20579(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:41:35 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfdad1b-84ab-4e91-95f2-2971a1b0afa9]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5453d83a-83a8-4327-8b16-327add9dffa3 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:36 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579 Apr 29 06:41:36 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:36 devstack sudo[89698]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-339235a8-f374-475a-b4e7-c2b90d0c2b6f 1073741824" returned: 0 in 0.810s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-339235a8-f374-475a-b4e7-c2b90d0c2b6f {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:36 devstack sudo[89711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-339235a8-f374-475a-b4e7-c2b90d0c2b6f Apr 29 06:41:36 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-060db5e9-8b6c-4a67-be06-e846f3cc7e06 tempest-VolumesSnapshotListTestJSON-1992088123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG oslo_service.periodic_task [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84195) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:36 devstack sudo[89717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:41:36 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:36 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5453d83a-83a8-4327-8b16-327add9dffa3 tempest-GroupSnapshotsTest-841847317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579" returned: 0 in 0.715s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5453d83a-83a8-4327-8b16-327add9dffa3 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.a37d3b42-0773-4350-838c-42b9fb98087b {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:36 devstack sudo[89720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.a37d3b42-0773-4350-838c-42b9fb98087b Apr 29 06:41:36 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:36 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-339235a8-f374-475a-b4e7-c2b90d0c2b6f" returned: 0 in 0.672s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.053s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-67240882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1f3f81-fbfe-4fba-b2fb-55e70140a7e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2c9f889c40b846a789111ea84729b4ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:41:32Z,use_quota=True,user_id='8286f9c86b3948579480102c5e32f587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Creating volume 2f1f3f81-fbfe-4fba-b2fb-55e70140a7e5 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:41:36 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-2f1f3f81-fbfe-4fba-b2fb-55e70140a7e5 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:36 devstack sudo[89722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-2f1f3f81-fbfe-4fba-b2fb-55e70140a7e5 1073741824 Apr 29 06:41:36 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b750aaa-183d-40aa-9237-0b780d2e26ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-339235a8-f374-475a-b4e7-c2b90d0c2b6f', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55eba0e9-68de-4dc2-b2af-b40041d64dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:36 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Volume volume-339235a8-f374-475a-b4e7-c2b90d0c2b6f (339235a8-f374-475a-b4e7-c2b90d0c2b6f): created successfully Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55eba0e9-68de-4dc2-b2af-b40041d64dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Flow 'volume_create_manager' (e54830df-7219-410d-a1c4-1a4e7c31835f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:41:36 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-bf3c2218-882a-4bf5-9cb6-55ee3e4b1c79 tempest-VolumesGetTest-1294989752 None] Created volume successfully. Apr 29 06:41:37 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.695s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:37 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:41:37 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5453d83a-83a8-4327-8b16-327add9dffa3 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.a37d3b42-0773-4350-838c-42b9fb98087b" returned: 0 in 0.822s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5453d83a-83a8-4327-8b16-327add9dffa3 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.a37d3b42-0773-4350-838c-42b9fb98087b {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:37 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.a37d3b42-0773-4350-838c-42b9fb98087b Apr 29 06:41:37 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:37 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-20e799ae-4d22-4eed-ac26-cb470f677fec tempest-VolumesGetTest-1294989752 None] Acquiring lock "cinder-339235a8-f374-475a-b4e7-c2b90d0c2b6f-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:37 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-20e799ae-4d22-4eed-ac26-cb470f677fec tempest-VolumesGetTest-1294989752 None] Lock "cinder-339235a8-f374-475a-b4e7-c2b90d0c2b6f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:37 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-20e799ae-4d22-4eed-ac26-cb470f677fec tempest-VolumesGetTest-1294989752 None] Acquiring lock "cinder-quobyte-339235a8-f374-475a-b4e7-c2b90d0c2b6f" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:37 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-20e799ae-4d22-4eed-ac26-cb470f677fec tempest-VolumesGetTest-1294989752 None] Lock "cinder-quobyte-339235a8-f374-475a-b4e7-c2b90d0c2b6f" acquired by "delete_volume" :: waited 0.018s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:37 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3ed1a5-d834-4ff4-8ab1-aa463062a78a]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-20e799ae-4d22-4eed-ac26-cb470f677fec tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-339235a8-f374-475a-b4e7-c2b90d0c2b6f {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:37 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-2f1f3f81-fbfe-4fba-b2fb-55e70140a7e5 1073741824" returned: 0 in 0.949s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-2f1f3f81-fbfe-4fba-b2fb-55e70140a7e5 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:37 devstack sudo[89734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-2f1f3f81-fbfe-4fba-b2fb-55e70140a7e5 Apr 29 06:41:37 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:37 devstack sudo[89733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-339235a8-f374-475a-b4e7-c2b90d0c2b6f Apr 29 06:41:37 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:38 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5453d83a-83a8-4327-8b16-327add9dffa3 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579.a37d3b42-0773-4350-838c-42b9fb98087b" returned: 0 in 0.689s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:38 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5453d83a-83a8-4327-8b16-327add9dffa3 tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-a37d3b42-0773-4350-838c-42b9fb98087b" released by "_delete_snapshot" :: held 3.056s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:38 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5453d83a-83a8-4327-8b16-327add9dffa3 tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-ba5411ac-0ea5-4179-adcc-85d825e20579" released by "delete_snapshot" :: held 3.078s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:38 devstack cinder-volume[84195]: WARNING cinder.quota [None req-5453d83a-83a8-4327-8b16-327add9dffa3 tempest-GroupSnapshotsTest-841847317 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-278564052 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-278564052, it is now deprecated. Please use the default quota class for default quota. Apr 29 06:41:38 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-5453d83a-83a8-4327-8b16-327add9dffa3 tempest-GroupSnapshotsTest-841847317 None] Created reservations ['ace0af49-ec83-4e90-8c39-53f0db7f2ff9', '068e813d-96a3-46f0-8f1a-401e75fecb96', '2c26bd0d-3526-4d72-abb6-6c6e63b91421', 'cc4923f6-5a66-449c-a2a9-fd7fad7f9ed5'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:41:38 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-5453d83a-83a8-4327-8b16-327add9dffa3 tempest-GroupSnapshotsTest-841847317 None] group_snapshot bd29b9b9-848f-4c26-a0f6-26dfae1f38e4: deleted successfully Apr 29 06:41:38 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-2f1f3f81-fbfe-4fba-b2fb-55e70140a7e5" returned: 0 in 0.661s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:38 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:41:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-060db5e9-8b6c-4a67-be06-e846f3cc7e06 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.034s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:38 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e56407-f2db-453e-976e-ec416802f88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f1f3f81-fbfe-4fba-b2fb-55e70140a7e5', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:38 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (496ff765-562b-4ba1-bc74-47e1e03948cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:38 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-060db5e9-8b6c-4a67-be06-e846f3cc7e06 tempest-VolumesSnapshotListTestJSON-1992088123 None] Creating offline snapshot 81262254-c9dc-474e-8b17-11ce21fee0a5 of volume c7b9e834-1a53-4048-a4df-71e13c1ea90c {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:41:38 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-20e799ae-4d22-4eed-ac26-cb470f677fec tempest-VolumesGetTest-1294989752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-339235a8-f374-475a-b4e7-c2b90d0c2b6f" returned: 0 in 0.812s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-20e799ae-4d22-4eed-ac26-cb470f677fec tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-339235a8-f374-475a-b4e7-c2b90d0c2b6f {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:38 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[41705880-dd06-4835-837e-048ca7a6916f]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-060db5e9-8b6c-4a67-be06-e846f3cc7e06 tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:38 devstack sudo[89743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-339235a8-f374-475a-b4e7-c2b90d0c2b6f Apr 29 06:41:38 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:38 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Volume volume-2f1f3f81-fbfe-4fba-b2fb-55e70140a7e5 (2f1f3f81-fbfe-4fba-b2fb-55e70140a7e5): created successfully Apr 29 06:41:38 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (496ff765-562b-4ba1-bc74-47e1e03948cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:38 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Flow 'volume_create_manager' (8d12d7f9-e6c8-4a0c-8ad7-f780e90a5599) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:41:38 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-8d30076a-f21c-4089-bb17-72bcbf0a54e0 tempest-VolumesTestJSON-1937566554 None] Created volume successfully. Apr 29 06:41:38 devstack sudo[89744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96 Apr 29 06:41:38 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:39 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-20e799ae-4d22-4eed-ac26-cb470f677fec tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-339235a8-f374-475a-b4e7-c2b90d0c2b6f" returned: 0 in 0.623s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-20e799ae-4d22-4eed-ac26-cb470f677fec tempest-VolumesGetTest-1294989752 None] Lock "cinder-quobyte-339235a8-f374-475a-b4e7-c2b90d0c2b6f" released by "delete_volume" :: held 1.479s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-20e799ae-4d22-4eed-ac26-cb470f677fec tempest-VolumesGetTest-1294989752 None] Created reservations ['f9cf6210-c009-4bb7-afb2-e732639f67ae', 'f1605824-a98d-48f5-bfab-da70f74cef14', '38bfb75a-e644-481f-aebb-71a22dd5c052', '55020876-03c2-47c8-a278-6ed5530b3b2e'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-20e799ae-4d22-4eed-ac26-cb470f677fec tempest-VolumesGetTest-1294989752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-20e799ae-4d22-4eed-ac26-cb470f677fec tempest-VolumesGetTest-1294989752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-20e799ae-4d22-4eed-ac26-cb470f677fec tempest-VolumesGetTest-1294989752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-20e799ae-4d22-4eed-ac26-cb470f677fec tempest-VolumesGetTest-1294989752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-20e799ae-4d22-4eed-ac26-cb470f677fec tempest-VolumesGetTest-1294989752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-20e799ae-4d22-4eed-ac26-cb470f677fec tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:39 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-060db5e9-8b6c-4a67-be06-e846f3cc7e06 tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96" returned: 0 in 0.763s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-060db5e9-8b6c-4a67-be06-e846f3cc7e06 tempest-VolumesSnapshotListTestJSON-1992088123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-060db5e9-8b6c-4a67-be06-e846f3cc7e06 tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:39 devstack sudo[89751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:41:39 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:39 devstack sudo[89752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5 1G Apr 29 06:41:39 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-25cd0422-5a7a-4a4b-bff3-3b81874d3705 tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "cinder-quobyte-ba5411ac-0ea5-4179-adcc-85d825e20579" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-25cd0422-5a7a-4a4b-bff3-3b81874d3705 tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-ba5411ac-0ea5-4179-adcc-85d825e20579" acquired by "delete_volume" :: waited 0.056s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeec448c-8870-4e52-b138-e0d298e73785]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-25cd0422-5a7a-4a4b-bff3-3b81874d3705 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Flow 'volume_create_manager' (5c1f1c95-0156-4483-b034-c64d25727a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0277ee49-ba66-47d9-8de2-70055ea40434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0277ee49-ba66-47d9-8de2-70055ea40434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-689786258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f23c0537-3626-478e-837a-e749aca6e705,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2c9f889c40b846a789111ea84729b4ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:41:40Z,use_quota=True,user_id='8286f9c86b3948579480102c5e32f587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c5b5b68-11c7-4acf-879e-c84c978d4797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c5b5b68-11c7-4acf-879e-c84c978d4797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c905432-3148-490f-9f3b-bd38a515cf2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c905432-3148-490f-9f3b-bd38a515cf2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f23c0537-3626-478e-837a-e749aca6e705', 'volume_name': 'volume-f23c0537-3626-478e-837a-e749aca6e705', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ecec522-db8c-400c-a92e-791f3c94c7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ecec522-db8c-400c-a92e-791f3c94c7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aefd2261-45c4-495a-ad9c-972b097afcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:39 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Volume f23c0537-3626-478e-837a-e749aca6e705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f23c0537-3626-478e-837a-e749aca6e705', 'volume_size': 1} Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3d536ffc-2e2f-486e-90c3-3aaf37f90001 tempest-VolumesGetTest-1294989752 None] Acquiring lock "cinder-9a18d5f9-fa4e-491c-833a-dc80af5e62c9-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:39 devstack sudo[89755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579 Apr 29 06:41:39 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:39 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3d536ffc-2e2f-486e-90c3-3aaf37f90001 tempest-VolumesGetTest-1294989752 None] Lock "cinder-9a18d5f9-fa4e-491c-833a-dc80af5e62c9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:40 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3d536ffc-2e2f-486e-90c3-3aaf37f90001 tempest-VolumesGetTest-1294989752 None] Acquiring lock "cinder-quobyte-9a18d5f9-fa4e-491c-833a-dc80af5e62c9" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:40 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3d536ffc-2e2f-486e-90c3-3aaf37f90001 tempest-VolumesGetTest-1294989752 None] Lock "cinder-quobyte-9a18d5f9-fa4e-491c-833a-dc80af5e62c9" acquired by "delete_volume" :: waited 0.020s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:40 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd526c3-a2e0-4696-aabc-67abae03e55f]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3d536ffc-2e2f-486e-90c3-3aaf37f90001 tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9a18d5f9-fa4e-491c-833a-dc80af5e62c9 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:40 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-20e799ae-4d22-4eed-ac26-cb470f677fec tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.806s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:40 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-20e799ae-4d22-4eed-ac26-cb470f677fec tempest-VolumesGetTest-1294989752 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:41:40 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-20e799ae-4d22-4eed-ac26-cb470f677fec tempest-VolumesGetTest-1294989752 None] Deleted volume successfully. Apr 29 06:41:40 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-20e799ae-4d22-4eed-ac26-cb470f677fec tempest-VolumesGetTest-1294989752 None] Lock "cinder-339235a8-f374-475a-b4e7-c2b90d0c2b6f-delete_volume" released by "delete_volume" :: held 2.500s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:40 devstack sudo[89760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9a18d5f9-fa4e-491c-833a-dc80af5e62c9 Apr 29 06:41:40 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:40 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-060db5e9-8b6c-4a67-be06-e846f3cc7e06 tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5 1G" returned: 0 in 1.057s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-060db5e9-8b6c-4a67-be06-e846f3cc7e06 tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:40 devstack sudo[89763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5 Apr 29 06:41:40 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:40 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-25cd0422-5a7a-4a4b-bff3-3b81874d3705 tempest-GroupSnapshotsTest-841847317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579" returned: 0 in 0.832s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-25cd0422-5a7a-4a4b-bff3-3b81874d3705 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:40 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579 Apr 29 06:41:40 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:40 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3d536ffc-2e2f-486e-90c3-3aaf37f90001 tempest-VolumesGetTest-1294989752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9a18d5f9-fa4e-491c-833a-dc80af5e62c9" returned: 0 in 0.838s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3d536ffc-2e2f-486e-90c3-3aaf37f90001 tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9a18d5f9-fa4e-491c-833a-dc80af5e62c9 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:40 devstack sudo[89777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9a18d5f9-fa4e-491c-833a-dc80af5e62c9 Apr 29 06:41:40 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:41 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-060db5e9-8b6c-4a67-be06-e846f3cc7e06 tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5" returned: 0 in 0.685s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:41 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-060db5e9-8b6c-4a67-be06-e846f3cc7e06 tempest-VolumesSnapshotListTestJSON-1992088123 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5 is being set with open permissions: ugo+rw Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-060db5e9-8b6c-4a67-be06-e846f3cc7e06 tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:41 devstack sudo[89779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5 Apr 29 06:41:41 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:41 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-25cd0422-5a7a-4a4b-bff3-3b81874d3705 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ba5411ac-0ea5-4179-adcc-85d825e20579" returned: 0 in 0.664s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-25cd0422-5a7a-4a4b-bff3-3b81874d3705 tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-ba5411ac-0ea5-4179-adcc-85d825e20579" released by "delete_volume" :: held 1.619s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-25cd0422-5a7a-4a4b-bff3-3b81874d3705 tempest-GroupSnapshotsTest-841847317 None] Created reservations ['720aaa8e-adbf-4f91-bab7-772932198928'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:41:41 devstack cinder-volume[84195]: WARNING cinder.db.sqlalchemy.api [None req-25cd0422-5a7a-4a4b-bff3-3b81874d3705 tempest-GroupSnapshotsTest-841847317 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-278564052'] Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-25cd0422-5a7a-4a4b-bff3-3b81874d3705 tempest-GroupSnapshotsTest-841847317 None] Created reservations ['cdc7df3b-a5cc-4bee-b43b-739e23c8e2b9', '52ac0f4f-1468-4f03-9f58-88b2bb6c0160', '061359cd-02f0-49a1-acdf-c32ea4853d72', '42117ee3-cb48-46fe-a09b-614e03f160bc'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-25cd0422-5a7a-4a4b-bff3-3b81874d3705 tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-25cd0422-5a7a-4a4b-bff3-3b81874d3705 tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-25cd0422-5a7a-4a4b-bff3-3b81874d3705 tempest-GroupSnapshotsTest-841847317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-25cd0422-5a7a-4a4b-bff3-3b81874d3705 tempest-GroupSnapshotsTest-841847317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-25cd0422-5a7a-4a4b-bff3-3b81874d3705 tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-25cd0422-5a7a-4a4b-bff3-3b81874d3705 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:41 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:41:41 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:41 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3d536ffc-2e2f-486e-90c3-3aaf37f90001 tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9a18d5f9-fa4e-491c-833a-dc80af5e62c9" returned: 0 in 0.711s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3d536ffc-2e2f-486e-90c3-3aaf37f90001 tempest-VolumesGetTest-1294989752 None] Lock "cinder-quobyte-9a18d5f9-fa4e-491c-833a-dc80af5e62c9" released by "delete_volume" :: held 1.606s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:41 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-060db5e9-8b6c-4a67-be06-e846f3cc7e06 tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5" returned: 0 in 0.639s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-3d536ffc-2e2f-486e-90c3-3aaf37f90001 tempest-VolumesGetTest-1294989752 None] Created reservations ['a9902aef-4f6a-4161-9cf7-95aea9025f55', '8b63332a-1d08-4779-8370-b0dc42c68b32', '7b6c6467-cea8-44c3-8d06-b4ce73e87311', '29d78cac-89ff-416a-8e7b-f1764ce7f123'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-060db5e9-8b6c-4a67-be06-e846f3cc7e06 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.274s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.801s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-689786258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f23c0537-3626-478e-837a-e749aca6e705,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2c9f889c40b846a789111ea84729b4ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:41:40Z,use_quota=True,user_id='8286f9c86b3948579480102c5e32f587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Creating volume f23c0537-3626-478e-837a-e749aca6e705 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:41:41 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f23c0537-3626-478e-837a-e749aca6e705 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:41 devstack sudo[89786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f23c0537-3626-478e-837a-e749aca6e705 1073741824 Apr 29 06:41:41 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:41 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-060db5e9-8b6c-4a67-be06-e846f3cc7e06 tempest-VolumesSnapshotListTestJSON-1992088123 None] Create snapshot completed successfully Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3d536ffc-2e2f-486e-90c3-3aaf37f90001 tempest-VolumesGetTest-1294989752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3d536ffc-2e2f-486e-90c3-3aaf37f90001 tempest-VolumesGetTest-1294989752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-3d536ffc-2e2f-486e-90c3-3aaf37f90001 tempest-VolumesGetTest-1294989752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-3d536ffc-2e2f-486e-90c3-3aaf37f90001 tempest-VolumesGetTest-1294989752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3d536ffc-2e2f-486e-90c3-3aaf37f90001 tempest-VolumesGetTest-1294989752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3d536ffc-2e2f-486e-90c3-3aaf37f90001 tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:41 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:41:41 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:42 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-25cd0422-5a7a-4a4b-bff3-3b81874d3705 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.803s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:42 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-25cd0422-5a7a-4a4b-bff3-3b81874d3705 tempest-GroupSnapshotsTest-841847317 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:41:42 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-25cd0422-5a7a-4a4b-bff3-3b81874d3705 tempest-GroupSnapshotsTest-841847317 None] Delete group completed successfully. Apr 29 06:41:42 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-872289c9-5806-409b-97dc-51b3008b3c6c tempest-GroupSnapshotsTest-841847317 None] Group tempest-GroupSnapshotsTest-Group-240460079: creating Apr 29 06:41:42 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-872289c9-5806-409b-97dc-51b3008b3c6c tempest-GroupSnapshotsTest-841847317 None] Group tempest-GroupSnapshotsTest-Group-240460079: created successfully Apr 29 06:41:42 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-872289c9-5806-409b-97dc-51b3008b3c6c tempest-GroupSnapshotsTest-841847317 None] Create group completed successfully. Apr 29 06:41:42 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3d536ffc-2e2f-486e-90c3-3aaf37f90001 tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.803s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:42 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-3d536ffc-2e2f-486e-90c3-3aaf37f90001 tempest-VolumesGetTest-1294989752 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:41:42 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-3d536ffc-2e2f-486e-90c3-3aaf37f90001 tempest-VolumesGetTest-1294989752 None] Deleted volume successfully. Apr 29 06:41:42 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3d536ffc-2e2f-486e-90c3-3aaf37f90001 tempest-VolumesGetTest-1294989752 None] Lock "cinder-9a18d5f9-fa4e-491c-833a-dc80af5e62c9-delete_volume" released by "delete_volume" :: held 2.723s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:42 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f23c0537-3626-478e-837a-e749aca6e705 1073741824" returned: 0 in 1.066s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f23c0537-3626-478e-837a-e749aca6e705 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:42 devstack sudo[89795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f23c0537-3626-478e-837a-e749aca6e705 Apr 29 06:41:42 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-b06040fa-3401-4e36-85e3-a494ade31dcb tempest-VolumesSnapshotListTestJSON-1992088123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:43 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f23c0537-3626-478e-837a-e749aca6e705" returned: 0 in 0.626s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:43 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:41:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-b06040fa-3401-4e36-85e3-a494ade31dcb tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.558s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aefd2261-45c4-495a-ad9c-972b097afcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f23c0537-3626-478e-837a-e749aca6e705', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6fe333d-3eb1-40c2-9699-a4ed4d09d68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:43 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-b06040fa-3401-4e36-85e3-a494ade31dcb tempest-VolumesSnapshotListTestJSON-1992088123 None] Creating offline snapshot a0260b60-2c59-448c-8927-7abb556312b0 of volume c7b9e834-1a53-4048-a4df-71e13c1ea90c {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:41:43 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Volume volume-f23c0537-3626-478e-837a-e749aca6e705 (f23c0537-3626-478e-837a-e749aca6e705): created successfully Apr 29 06:41:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6fe333d-3eb1-40c2-9699-a4ed4d09d68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Flow 'volume_create_manager' (5c1f1c95-0156-4483-b034-c64d25727a80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:41:43 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[093eb0fd-3bd7-442a-a702-53ca3c5e1373]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b06040fa-3401-4e36-85e3-a494ade31dcb tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:43 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-c35647fc-be29-4b8f-9263-9990d6cd3ffe tempest-VolumesTestJSON-1937566554 None] Created volume successfully. Apr 29 06:41:43 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:41:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Flow 'volume_create_manager' (b2202b98-2b5c-4426-97c1-0cf057c44d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:41:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4657c4-25dc-40a7-9947-090180e9d095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4657c4-25dc-40a7-9947-090180e9d095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-225707929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de093ceebc784c93b0b02e0c89978247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:41:44Z,use_quota=True,user_id='46456f53c8ca414a88ce4258a59158ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ed9f9c-274d-4032-92fa-f389a1cbd3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ed9f9c-274d-4032-92fa-f389a1cbd3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293ee968-99d4-4732-979e-47d6bf288a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:43 devstack sudo[89798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5 Apr 29 06:41:43 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293ee968-99d4-4732-979e-47d6bf288a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca', 'volume_name': 'volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe68f14-c230-4711-af38-9a2edf5de1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe68f14-c230-4711-af38-9a2edf5de1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9962c5-9c3c-47c2-a85d-30d06bdae09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:43 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Volume 9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca', 'volume_size': 1} Apr 29 06:41:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:44 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:41:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Flow 'volume_create_manager' (3a09a4c2-106a-46c6-a282-7dbaee6f0cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:41:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76723f0-dfb8-455a-b3d4-a2bc2b427000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76723f0-dfb8-455a-b3d4-a2bc2b427000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1851586605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5f04b6ac-10e4-42b8-ae16-365cad873a63,host='devstack@QuobyteHD#QuobyteHD',id=20bc01db-c1ef-46f0-ae7d-36c8eafe9c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d9e7b170394e1093075e88f3deb2fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:41:44Z,use_quota=True,user_id='5ebe735b9fb04d90a78dc3c973080675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42ab2582-daef-42f4-966d-e94f17c0d710),volume_type_id=42ab2582-daef-42f4-966d-e94f17c0d710)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed6b533-b4c5-4fa7-b7c2-290f2ae55e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed6b533-b4c5-4fa7-b7c2-290f2ae55e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ddb4ed9-c1c0-46dc-9bad-13eb4b45ff9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ddb4ed9-c1c0-46dc-9bad-13eb4b45ff9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20bc01db-c1ef-46f0-ae7d-36c8eafe9c86', 'volume_name': 'volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4160b34c-bb6c-4faf-b071-43296b88ceba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4160b34c-bb6c-4faf-b071-43296b88ceba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c75a83-a196-4d2d-8c6d-4a26ce072f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:44 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Volume 20bc01db-c1ef-46f0-ae7d-36c8eafe9c86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86', 'volume_size': 1} Apr 29 06:41:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:44 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b06040fa-3401-4e36-85e3-a494ade31dcb tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5" returned: 0 in 0.787s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-b06040fa-3401-4e36-85e3-a494ade31dcb tempest-VolumesSnapshotListTestJSON-1992088123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:41:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b06040fa-3401-4e36-85e3-a494ade31dcb tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.a0260b60-2c59-448c-8927-7abb556312b0 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:44 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.a0260b60-2c59-448c-8927-7abb556312b0 1G Apr 29 06:41:44 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:44 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:41:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Flow 'volume_create_manager' (beb1aa82-f115-45a0-b0e8-be7f047c939e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:41:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1442227f-f604-404f-a061-a53e80d9a34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1442227f-f604-404f-a061-a53e80d9a34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1813452204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc9d6fb-615e-4f23-b312-adbac738d2f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2c9f889c40b846a789111ea84729b4ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:41:45Z,use_quota=True,user_id='8286f9c86b3948579480102c5e32f587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b4e197c-222a-4808-b596-7f75f4879cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b4e197c-222a-4808-b596-7f75f4879cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a4e8183-f0c1-45df-a63f-4a64b83a8dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a4e8183-f0c1-45df-a63f-4a64b83a8dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fc9d6fb-615e-4f23-b312-adbac738d2f8', 'volume_name': 'volume-1fc9d6fb-615e-4f23-b312-adbac738d2f8', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58cd9fd0-d456-4a06-a316-97c680e14fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58cd9fd0-d456-4a06-a316-97c680e14fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc412fa-d2ca-4db1-8a10-1ed212863b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:44 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Volume 1fc9d6fb-615e-4f23-b312-adbac738d2f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fc9d6fb-615e-4f23-b312-adbac738d2f8', 'volume_size': 1} Apr 29 06:41:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:45 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b06040fa-3401-4e36-85e3-a494ade31dcb tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.a0260b60-2c59-448c-8927-7abb556312b0 1G" returned: 0 in 0.845s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b06040fa-3401-4e36-85e3-a494ade31dcb tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.a0260b60-2c59-448c-8927-7abb556312b0 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:45 devstack sudo[89808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.a0260b60-2c59-448c-8927-7abb556312b0 Apr 29 06:41:45 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:45 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b06040fa-3401-4e36-85e3-a494ade31dcb tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.a0260b60-2c59-448c-8927-7abb556312b0" returned: 0 in 0.633s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:45 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-b06040fa-3401-4e36-85e3-a494ade31dcb tempest-VolumesSnapshotListTestJSON-1992088123 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.a0260b60-2c59-448c-8927-7abb556312b0 is being set with open permissions: ugo+rw Apr 29 06:41:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b06040fa-3401-4e36-85e3-a494ade31dcb tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.a0260b60-2c59-448c-8927-7abb556312b0 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:45 devstack sudo[89813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.a0260b60-2c59-448c-8927-7abb556312b0 Apr 29 06:41:45 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:46 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b06040fa-3401-4e36-85e3-a494ade31dcb tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.a0260b60-2c59-448c-8927-7abb556312b0" returned: 0 in 0.610s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-b06040fa-3401-4e36-85e3-a494ade31dcb tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.072s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.763s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-225707929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de093ceebc784c93b0b02e0c89978247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:41:44Z,use_quota=True,user_id='46456f53c8ca414a88ce4258a59158ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:41:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Creating volume 9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:41:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:41:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:41:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:41:46 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:41:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:46 devstack sudo[89819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca 1073741824 Apr 29 06:41:46 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:46 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-b06040fa-3401-4e36-85e3-a494ade31dcb tempest-VolumesSnapshotListTestJSON-1992088123 None] Create snapshot completed successfully Apr 29 06:41:47 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca 1073741824" returned: 0 in 0.790s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:47 devstack sudo[89826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca Apr 29 06:41:47 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8fe0f5fb-8d1c-4a91-88eb-6cca13ac4827 tempest-VolumesSnapshotListTestJSON-1992088123 None] Acquiring lock "cinder-a0260b60-2c59-448c-8927-7abb556312b0-delete_snapshot" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8fe0f5fb-8d1c-4a91-88eb-6cca13ac4827 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "cinder-a0260b60-2c59-448c-8927-7abb556312b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8fe0f5fb-8d1c-4a91-88eb-6cca13ac4827 tempest-VolumesSnapshotListTestJSON-1992088123 None] Acquiring lock "cinder-quobyte-c7b9e834-1a53-4048-a4df-71e13c1ea90c" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8fe0f5fb-8d1c-4a91-88eb-6cca13ac4827 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "cinder-quobyte-c7b9e834-1a53-4048-a4df-71e13c1ea90c" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8fe0f5fb-8d1c-4a91-88eb-6cca13ac4827 tempest-VolumesSnapshotListTestJSON-1992088123 None] Acquiring lock "cinder-quobyte-a0260b60-2c59-448c-8927-7abb556312b0" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8fe0f5fb-8d1c-4a91-88eb-6cca13ac4827 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "cinder-quobyte-a0260b60-2c59-448c-8927-7abb556312b0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-8fe0f5fb-8d1c-4a91-88eb-6cca13ac4827 tempest-VolumesSnapshotListTestJSON-1992088123 None] Deleting offline snapshot a0260b60-2c59-448c-8927-7abb556312b0 of volume c7b9e834-1a53-4048-a4df-71e13c1ea90c {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:41:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-8fe0f5fb-8d1c-4a91-88eb-6cca13ac4827 tempest-VolumesSnapshotListTestJSON-1992088123 None] snapshot_file for this snap is: volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.a0260b60-2c59-448c-8927-7abb556312b0 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:41:47 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[953db670-81c7-44a1-81c0-39400dc75c5f]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8fe0f5fb-8d1c-4a91-88eb-6cca13ac4827 tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.a0260b60-2c59-448c-8927-7abb556312b0 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:48 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca" returned: 0 in 0.684s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:48 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:41:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.840s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:48 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5f04b6ac-10e4-42b8-ae16-365cad873a63,created_at=2026-04-29T04:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1851586605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5f04b6ac-10e4-42b8-ae16-365cad873a63,host='devstack@QuobyteHD#QuobyteHD',id=20bc01db-c1ef-46f0-ae7d-36c8eafe9c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d9e7b170394e1093075e88f3deb2fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:41:44Z,use_quota=True,user_id='5ebe735b9fb04d90a78dc3c973080675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42ab2582-daef-42f4-966d-e94f17c0d710),volume_type_id=42ab2582-daef-42f4-966d-e94f17c0d710)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:41:48 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Creating volume 20bc01db-c1ef-46f0-ae7d-36c8eafe9c86 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:41:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:48 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:41:48 devstack sudo[89829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.a0260b60-2c59-448c-8927-7abb556312b0 Apr 29 06:41:48 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:48 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:41:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:48 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:41:48 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:41:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9962c5-9c3c-47c2-a85d-30d06bdae09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:48 devstack sudo[89831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86 1073741824 Apr 29 06:41:48 devstack sudo[89831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84bf107d-55a3-4162-8fbe-dbd512da3593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:48 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Volume volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca (9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca): created successfully Apr 29 06:41:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84bf107d-55a3-4162-8fbe-dbd512da3593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Flow 'volume_create_manager' (b2202b98-2b5c-4426-97c1-0cf057c44d0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:41:48 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-d59b27df-cd20-4e2e-be75-21a99dbe2182 tempest-VolumesGetTest-1294989752 None] Created volume successfully. Apr 29 06:41:48 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8fe0f5fb-8d1c-4a91-88eb-6cca13ac4827 tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.a0260b60-2c59-448c-8927-7abb556312b0" returned: 0 in 0.777s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:48 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-8fe0f5fb-8d1c-4a91-88eb-6cca13ac4827 tempest-VolumesSnapshotListTestJSON-1992088123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:41:48 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c01dfff-3221-4e3b-9b9c-10ff070cbaba]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8fe0f5fb-8d1c-4a91-88eb-6cca13ac4827 tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:48 devstack sudo[89831]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86 1073741824" returned: 0 in 0.772s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:48 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5 Apr 29 06:41:48 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:48 devstack sudo[89842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86 Apr 29 06:41:48 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:41:49 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Flow 'volume_create_manager' (f29661ff-5405-487d-80e0-2168eb88b565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (613faae7-88c1-4126-b7b2-f8a1297cffe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86" returned: 0 in 0.656s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.721s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1813452204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc9d6fb-615e-4f23-b312-adbac738d2f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2c9f889c40b846a789111ea84729b4ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:41:45Z,use_quota=True,user_id='8286f9c86b3948579480102c5e32f587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Creating volume 1fc9d6fb-615e-4f23-b312-adbac738d2f8 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:41:49 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1fc9d6fb-615e-4f23-b312-adbac738d2f8 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (613faae7-88c1-4126-b7b2-f8a1297cffe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2060135991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39997c9d-97dd-4ec7-8a75-2e563a3f1c39,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='de093ceebc784c93b0b02e0c89978247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca,status='creating',terminated_at=None,updated_at=2026-04-29T04:41:49Z,use_quota=True,user_id='46456f53c8ca414a88ce4258a59158ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f10abf9-c177-43cb-bde0-82e00facc80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f10abf9-c177-43cb-bde0-82e00facc80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:49 devstack sudo[89848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1fc9d6fb-615e-4f23-b312-adbac738d2f8 1073741824 Apr 29 06:41:49 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8aae765-4eb6-4353-bb99-c54081ba35ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:49 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8fe0f5fb-8d1c-4a91-88eb-6cca13ac4827 tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5" returned: 0 in 0.831s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-8fe0f5fb-8d1c-4a91-88eb-6cca13ac4827 tempest-VolumesSnapshotListTestJSON-1992088123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8fe0f5fb-8d1c-4a91-88eb-6cca13ac4827 tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.a0260b60-2c59-448c-8927-7abb556312b0 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c75a83-a196-4d2d-8c6d-4a26ce072f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:49 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.a0260b60-2c59-448c-8927-7abb556312b0 Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a27d9da3-9634-4512-a3af-e87185f109c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:49 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8aae765-4eb6-4353-bb99-c54081ba35ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '39997c9d-97dd-4ec7-8a75-2e563a3f1c39', 'volume_name': 'volume-39997c9d-97dd-4ec7-8a75-2e563a3f1c39', 'volume_size': 1, 'source_volid': '9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca', 'source_volstatus': 'available'}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e37b33f-9e7f-430d-85d8-e492a2562843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e37b33f-9e7f-430d-85d8-e492a2562843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ed5001-0f2e-4117-a94f-28501a6bebe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:49 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Volume 39997c9d-97dd-4ec7-8a75-2e563a3f1c39: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-39997c9d-97dd-4ec7-8a75-2e563a3f1c39', 'volume_size': 1, 'source_volid': '9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca', 'source_volstatus': 'available'} Apr 29 06:41:49 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Volume volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86 (20bc01db-c1ef-46f0-ae7d-36c8eafe9c86): created successfully Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a27d9da3-9634-4512-a3af-e87185f109c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Flow 'volume_create_manager' (3a09a4c2-106a-46c6-a282-7dbaee6f0cd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:41:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:49 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-75089e1b-301f-4b53-a4e9-008f92d95592 tempest-GroupSnapshotsTest-841847317 None] Created volume successfully. Apr 29 06:41:50 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1fc9d6fb-615e-4f23-b312-adbac738d2f8 1073741824" returned: 0 in 0.803s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:50 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8fe0f5fb-8d1c-4a91-88eb-6cca13ac4827 tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.a0260b60-2c59-448c-8927-7abb556312b0" returned: 0 in 0.761s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8fe0f5fb-8d1c-4a91-88eb-6cca13ac4827 tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.a0260b60-2c59-448c-8927-7abb556312b0 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:50 devstack sudo[89859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.a0260b60-2c59-448c-8927-7abb556312b0 Apr 29 06:41:50 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1fc9d6fb-615e-4f23-b312-adbac738d2f8 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:50 devstack sudo[89861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1fc9d6fb-615e-4f23-b312-adbac738d2f8 Apr 29 06:41:50 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:50 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8fe0f5fb-8d1c-4a91-88eb-6cca13ac4827 tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.a0260b60-2c59-448c-8927-7abb556312b0" returned: 0 in 0.624s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:51 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1fc9d6fb-615e-4f23-b312-adbac738d2f8" returned: 0 in 0.618s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8fe0f5fb-8d1c-4a91-88eb-6cca13ac4827 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "cinder-quobyte-a0260b60-2c59-448c-8927-7abb556312b0" released by "_delete_snapshot" :: held 3.123s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.362s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:51 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Cloning volume 9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca to volume 39997c9d-97dd-4ec7-8a75-2e563a3f1c39 Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8fe0f5fb-8d1c-4a91-88eb-6cca13ac4827 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "cinder-quobyte-c7b9e834-1a53-4048-a4df-71e13c1ea90c" released by "delete_snapshot" :: held 3.166s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc412fa-d2ca-4db1-8a10-1ed212863b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fc9d6fb-615e-4f23-b312-adbac738d2f8', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14e8f7e-7d27-4c02-b698-77a1c8fb0e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Creating offline snapshot 50a2a827-5a72-43d2-a7fe-31253d058081 of volume 9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:41:51 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Volume volume-1fc9d6fb-615e-4f23-b312-adbac738d2f8 (1fc9d6fb-615e-4f23-b312-adbac738d2f8): created successfully Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14e8f7e-7d27-4c02-b698-77a1c8fb0e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Flow 'volume_create_manager' (beb1aa82-f115-45a0-b0e8-be7f047c939e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[689fc00e-be08-49b6-8819-53a08218611d]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:51 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-150dac4a-04bb-425e-9fe1-ba2abdc95ae3 tempest-VolumesTestJSON-1937566554 None] Created volume successfully. Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Flow 'volume_create_manager' (78bbd5dd-8f83-4c6b-93b9-6e7516909108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc847289-f60f-4f9a-877a-38095b653fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc847289-f60f-4f9a-877a-38095b653fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1249952215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5f04b6ac-10e4-42b8-ae16-365cad873a63,host='devstack@QuobyteHD#QuobyteHD',id=a5577d1c-295f-4fb0-80e2-526d4f878b94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d9e7b170394e1093075e88f3deb2fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:41:51Z,use_quota=True,user_id='5ebe735b9fb04d90a78dc3c973080675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42ab2582-daef-42f4-966d-e94f17c0d710),volume_type_id=42ab2582-daef-42f4-966d-e94f17c0d710)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b89b7a44-bebe-4ea5-bfbb-740850a4843d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b89b7a44-bebe-4ea5-bfbb-740850a4843d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09fea7d7-ebe5-472c-858b-651459341ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09fea7d7-ebe5-472c-858b-651459341ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5577d1c-295f-4fb0-80e2-526d4f878b94', 'volume_name': 'volume-a5577d1c-295f-4fb0-80e2-526d4f878b94', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c305f24f-f6cc-4309-8b35-c6e75f8c9447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c305f24f-f6cc-4309-8b35-c6e75f8c9447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3511adcc-017d-4fcc-a36b-7238b99eab43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:41:51 devstack sudo[89865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca Apr 29 06:41:51 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:51 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Volume a5577d1c-295f-4fb0-80e2-526d4f878b94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5577d1c-295f-4fb0-80e2-526d4f878b94', 'volume_size': 1} Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-8fe0f5fb-8d1c-4a91-88eb-6cca13ac4827 tempest-VolumesSnapshotListTestJSON-1992088123 None] Created reservations ['a3ecaee7-dcd8-4f9c-94fa-f4fa32e06ccb', '2d02cc7b-117f-43e9-a7b1-ec545a44b668', '230734d1-a79e-42ce-b449-3df9f56f2877', '242e7d15-8adc-4d7f-9e9f-ebf0bd07f272'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:41:51 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-8fe0f5fb-8d1c-4a91-88eb-6cca13ac4827 tempest-VolumesSnapshotListTestJSON-1992088123 None] Delete snapshot completed successfully. Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8fe0f5fb-8d1c-4a91-88eb-6cca13ac4827 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "cinder-a0260b60-2c59-448c-8927-7abb556312b0-delete_snapshot" released by "delete_snapshot" :: held 3.494s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:51 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca" returned: 0 in 0.749s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.50a2a827-5a72-43d2-a7fe-31253d058081 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:51 devstack sudo[89870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.50a2a827-5a72-43d2-a7fe-31253d058081 1G Apr 29 06:41:51 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:52 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ada7882b-4bd8-4b43-9e03-4a5b582dfdb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Acquiring lock "cinder-81262254-c9dc-474e-8b17-11ce21fee0a5-delete_snapshot" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:52 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ada7882b-4bd8-4b43-9e03-4a5b582dfdb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "cinder-81262254-c9dc-474e-8b17-11ce21fee0a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:52 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ada7882b-4bd8-4b43-9e03-4a5b582dfdb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Acquiring lock "cinder-quobyte-c7b9e834-1a53-4048-a4df-71e13c1ea90c" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:52 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ada7882b-4bd8-4b43-9e03-4a5b582dfdb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "cinder-quobyte-c7b9e834-1a53-4048-a4df-71e13c1ea90c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:52 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ada7882b-4bd8-4b43-9e03-4a5b582dfdb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Acquiring lock "cinder-quobyte-81262254-c9dc-474e-8b17-11ce21fee0a5" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:52 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ada7882b-4bd8-4b43-9e03-4a5b582dfdb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "cinder-quobyte-81262254-c9dc-474e-8b17-11ce21fee0a5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:52 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-ada7882b-4bd8-4b43-9e03-4a5b582dfdb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Deleting offline snapshot 81262254-c9dc-474e-8b17-11ce21fee0a5 of volume c7b9e834-1a53-4048-a4df-71e13c1ea90c {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:41:52 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-ada7882b-4bd8-4b43-9e03-4a5b582dfdb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] snapshot_file for this snap is: volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:41:52 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[16323e54-bb62-4cd3-bafd-64fd7e71f67b]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ada7882b-4bd8-4b43-9e03-4a5b582dfdb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:52 devstack sudo[89872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5 Apr 29 06:41:52 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:52 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.50a2a827-5a72-43d2-a7fe-31253d058081 1G" returned: 0 in 0.864s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.50a2a827-5a72-43d2-a7fe-31253d058081 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:52 devstack sudo[89878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.50a2a827-5a72-43d2-a7fe-31253d058081 Apr 29 06:41:52 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:53 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ada7882b-4bd8-4b43-9e03-4a5b582dfdb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5" returned: 0 in 0.792s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:53 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-ada7882b-4bd8-4b43-9e03-4a5b582dfdb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:41:53 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b25886f-f4e2-432d-a483-d9e435f2f881]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ada7882b-4bd8-4b43-9e03-4a5b582dfdb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:53 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-90c62eba-4506-4050-9dce-d928c810f5b6 tempest-VolumesTestJSON-1937566554 None] Acquiring lock "cinder-1fc9d6fb-615e-4f23-b312-adbac738d2f8-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:53 devstack sudo[89883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96 Apr 29 06:41:53 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:53 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-90c62eba-4506-4050-9dce-d928c810f5b6 tempest-VolumesTestJSON-1937566554 None] Lock "cinder-1fc9d6fb-615e-4f23-b312-adbac738d2f8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:53 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-90c62eba-4506-4050-9dce-d928c810f5b6 tempest-VolumesTestJSON-1937566554 None] Acquiring lock "cinder-quobyte-1fc9d6fb-615e-4f23-b312-adbac738d2f8" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:53 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-90c62eba-4506-4050-9dce-d928c810f5b6 tempest-VolumesTestJSON-1937566554 None] Lock "cinder-quobyte-1fc9d6fb-615e-4f23-b312-adbac738d2f8" acquired by "delete_volume" :: waited 0.016s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:53 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[082827d1-5d16-4302-bd36-a52e9baf64af]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-90c62eba-4506-4050-9dce-d928c810f5b6 tempest-VolumesTestJSON-1937566554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1fc9d6fb-615e-4f23-b312-adbac738d2f8 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:53 devstack sudo[89885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1fc9d6fb-615e-4f23-b312-adbac738d2f8 Apr 29 06:41:53 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:53 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.50a2a827-5a72-43d2-a7fe-31253d058081" returned: 0 in 0.750s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:53 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.50a2a827-5a72-43d2-a7fe-31253d058081 is being set with open permissions: ugo+rw Apr 29 06:41:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.50a2a827-5a72-43d2-a7fe-31253d058081 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:53 devstack sudo[89890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.50a2a827-5a72-43d2-a7fe-31253d058081 Apr 29 06:41:53 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:53 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ada7882b-4bd8-4b43-9e03-4a5b582dfdb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96" returned: 0 in 0.744s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:53 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-ada7882b-4bd8-4b43-9e03-4a5b582dfdb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:41:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ada7882b-4bd8-4b43-9e03-4a5b582dfdb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:53 devstack sudo[89896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5 Apr 29 06:41:53 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:54 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-90c62eba-4506-4050-9dce-d928c810f5b6 tempest-VolumesTestJSON-1937566554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1fc9d6fb-615e-4f23-b312-adbac738d2f8" returned: 0 in 0.810s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-90c62eba-4506-4050-9dce-d928c810f5b6 tempest-VolumesTestJSON-1937566554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1fc9d6fb-615e-4f23-b312-adbac738d2f8 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:54 devstack sudo[89902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1fc9d6fb-615e-4f23-b312-adbac738d2f8 Apr 29 06:41:54 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:54 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.50a2a827-5a72-43d2-a7fe-31253d058081" returned: 0 in 0.647s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:54 devstack sudo[89904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.info Apr 29 06:41:54 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:54 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ada7882b-4bd8-4b43-9e03-4a5b582dfdb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5" returned: 0 in 0.748s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ada7882b-4bd8-4b43-9e03-4a5b582dfdb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:54 devstack sudo[89909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5 Apr 29 06:41:54 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:54 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-90c62eba-4506-4050-9dce-d928c810f5b6 tempest-VolumesTestJSON-1937566554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1fc9d6fb-615e-4f23-b312-adbac738d2f8" returned: 0 in 0.668s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:54 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-90c62eba-4506-4050-9dce-d928c810f5b6 tempest-VolumesTestJSON-1937566554 None] Lock "cinder-quobyte-1fc9d6fb-615e-4f23-b312-adbac738d2f8" released by "delete_volume" :: held 1.537s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:54 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-90c62eba-4506-4050-9dce-d928c810f5b6 tempest-VolumesTestJSON-1937566554 None] Created reservations ['291e2451-b3dc-4798-bda6-fd5eafb67301', '347d2ce1-efb7-40b0-94a3-06e7f4b1b657', 'a3e532bc-3016-4a83-8a67-2b8167944592', 'b30a5d03-6b72-460e-bfec-79491f44f773'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:41:54 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.info" returned: 0 in 0.663s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:54 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.info is being set with open permissions: ugo+rw Apr 29 06:41:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:54 devstack sudo[89913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.info Apr 29 06:41:54 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-90c62eba-4506-4050-9dce-d928c810f5b6 tempest-VolumesTestJSON-1937566554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-90c62eba-4506-4050-9dce-d928c810f5b6 tempest-VolumesTestJSON-1937566554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:54 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-90c62eba-4506-4050-9dce-d928c810f5b6 tempest-VolumesTestJSON-1937566554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:41:54 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-90c62eba-4506-4050-9dce-d928c810f5b6 tempest-VolumesTestJSON-1937566554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:41:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-90c62eba-4506-4050-9dce-d928c810f5b6 tempest-VolumesTestJSON-1937566554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-90c62eba-4506-4050-9dce-d928c810f5b6 tempest-VolumesTestJSON-1937566554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:54 devstack sudo[89915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:41:54 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:55 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ada7882b-4bd8-4b43-9e03-4a5b582dfdb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.81262254-c9dc-474e-8b17-11ce21fee0a5" returned: 0 in 0.604s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ada7882b-4bd8-4b43-9e03-4a5b582dfdb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "cinder-quobyte-81262254-c9dc-474e-8b17-11ce21fee0a5" released by "_delete_snapshot" :: held 3.032s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ada7882b-4bd8-4b43-9e03-4a5b582dfdb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "cinder-quobyte-c7b9e834-1a53-4048-a4df-71e13c1ea90c" released by "delete_snapshot" :: held 3.058s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:55 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-ada7882b-4bd8-4b43-9e03-4a5b582dfdb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Created reservations ['854eb94f-0170-4c33-8dec-ba38a3109573', 'e89d9ab0-cc8a-4130-82e2-17facce81ad1', '67f42e0d-3bdc-47dc-a866-17fa0ae7372d', 'e71fd50f-32ef-4cee-9474-2bfd940f905e'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:41:55 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-ada7882b-4bd8-4b43-9e03-4a5b582dfdb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Delete snapshot completed successfully. Apr 29 06:41:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ada7882b-4bd8-4b43-9e03-4a5b582dfdb5 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "cinder-81262254-c9dc-474e-8b17-11ce21fee0a5-delete_snapshot" released by "delete_snapshot" :: held 3.224s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-710c95ed-6b90-4ddf-8444-d43afc192852 tempest-VolumesTestJSON-1937566554 None] Acquiring lock "cinder-f23c0537-3626-478e-837a-e749aca6e705-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-710c95ed-6b90-4ddf-8444-d43afc192852 tempest-VolumesTestJSON-1937566554 None] Lock "cinder-f23c0537-3626-478e-837a-e749aca6e705-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-710c95ed-6b90-4ddf-8444-d43afc192852 tempest-VolumesTestJSON-1937566554 None] Acquiring lock "cinder-quobyte-f23c0537-3626-478e-837a-e749aca6e705" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-710c95ed-6b90-4ddf-8444-d43afc192852 tempest-VolumesTestJSON-1937566554 None] Lock "cinder-quobyte-f23c0537-3626-478e-837a-e749aca6e705" acquired by "delete_volume" :: waited 0.033s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:55 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f46b80e-adef-436b-a617-816956debaa2]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-710c95ed-6b90-4ddf-8444-d43afc192852 tempest-VolumesTestJSON-1937566554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f23c0537-3626-478e-837a-e749aca6e705 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:55 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.info" returned: 0 in 0.730s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Acquiring lock "cinder-quobyte-39997c9d-97dd-4ec7-8a75-2e563a3f1c39" by "_copy_volume_from_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:55 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-90c62eba-4506-4050-9dce-d928c810f5b6 tempest-VolumesTestJSON-1937566554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.688s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:55 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-90c62eba-4506-4050-9dce-d928c810f5b6 tempest-VolumesTestJSON-1937566554 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:41:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Lock "cinder-quobyte-39997c9d-97dd-4ec7-8a75-2e563a3f1c39" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:55 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] snapshot: 50a2a827-5a72-43d2-a7fe-31253d058081, volume: 39997c9d-97dd-4ec7-8a75-2e563a3f1c39, {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 06:41:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:55 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:41:55 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:41:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:55 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-90c62eba-4506-4050-9dce-d928c810f5b6 tempest-VolumesTestJSON-1937566554 None] Deleted volume successfully. Apr 29 06:41:55 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0180745-fa3c-4505-81b8-957b6da3c27a]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:55 devstack sudo[89920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f23c0537-3626-478e-837a-e749aca6e705 Apr 29 06:41:55 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.50a2a827-5a72-43d2-a7fe-31253d058081 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-90c62eba-4506-4050-9dce-d928c810f5b6 tempest-VolumesTestJSON-1937566554 None] Lock "cinder-1fc9d6fb-615e-4f23-b312-adbac738d2f8-delete_volume" released by "delete_volume" :: held 2.536s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:55 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.50a2a827-5a72-43d2-a7fe-31253d058081 Apr 29 06:41:55 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:56 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-710c95ed-6b90-4ddf-8444-d43afc192852 tempest-VolumesTestJSON-1937566554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f23c0537-3626-478e-837a-e749aca6e705" returned: 0 in 0.739s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-710c95ed-6b90-4ddf-8444-d43afc192852 tempest-VolumesTestJSON-1937566554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f23c0537-3626-478e-837a-e749aca6e705 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:56 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f23c0537-3626-478e-837a-e749aca6e705 Apr 29 06:41:56 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:56 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4e3d71ac-5e6a-4c81-82a1-66469c004de7 tempest-VolumesSnapshotListTestJSON-1992088123 None] Acquiring lock "cinder-341d061b-db6d-476f-b9f8-d9dc69642e96-delete_snapshot" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:56 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4e3d71ac-5e6a-4c81-82a1-66469c004de7 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "cinder-341d061b-db6d-476f-b9f8-d9dc69642e96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:56 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4e3d71ac-5e6a-4c81-82a1-66469c004de7 tempest-VolumesSnapshotListTestJSON-1992088123 None] Acquiring lock "cinder-quobyte-c7b9e834-1a53-4048-a4df-71e13c1ea90c" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:56 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4e3d71ac-5e6a-4c81-82a1-66469c004de7 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "cinder-quobyte-c7b9e834-1a53-4048-a4df-71e13c1ea90c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:56 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4e3d71ac-5e6a-4c81-82a1-66469c004de7 tempest-VolumesSnapshotListTestJSON-1992088123 None] Acquiring lock "cinder-quobyte-341d061b-db6d-476f-b9f8-d9dc69642e96" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:56 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4e3d71ac-5e6a-4c81-82a1-66469c004de7 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "cinder-quobyte-341d061b-db6d-476f-b9f8-d9dc69642e96" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-4e3d71ac-5e6a-4c81-82a1-66469c004de7 tempest-VolumesSnapshotListTestJSON-1992088123 None] Deleting offline snapshot 341d061b-db6d-476f-b9f8-d9dc69642e96 of volume c7b9e834-1a53-4048-a4df-71e13c1ea90c {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:41:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-4e3d71ac-5e6a-4c81-82a1-66469c004de7 tempest-VolumesSnapshotListTestJSON-1992088123 None] snapshot_file for this snap is: volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:41:56 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfb0739-dc87-4ef9-87b5-24a38a80a8e6]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4e3d71ac-5e6a-4c81-82a1-66469c004de7 tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:56 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.50a2a827-5a72-43d2-a7fe-31253d058081" returned: 0 in 0.777s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:41:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 06:41:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Creating direct copy from snapshot {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 06:41:56 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce14da0f-fb24-401e-a1bd-22af5454a4c3]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:56 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96 Apr 29 06:41:56 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:56 devstack sudo[89934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca Apr 29 06:41:56 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:57 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-710c95ed-6b90-4ddf-8444-d43afc192852 tempest-VolumesTestJSON-1937566554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f23c0537-3626-478e-837a-e749aca6e705" returned: 0 in 0.714s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:57 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-710c95ed-6b90-4ddf-8444-d43afc192852 tempest-VolumesTestJSON-1937566554 None] Lock "cinder-quobyte-f23c0537-3626-478e-837a-e749aca6e705" released by "delete_volume" :: held 1.500s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:57 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-710c95ed-6b90-4ddf-8444-d43afc192852 tempest-VolumesTestJSON-1937566554 None] Created reservations ['c364a331-734e-4278-833b-b091a197c546', 'bee9107a-028d-4337-8422-05961227cf32', 'ba5fa96e-e73e-4bd9-bd3b-542e0e63de03', '77d8c745-c663-4628-8f24-37faa35fbc42'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:41:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-710c95ed-6b90-4ddf-8444-d43afc192852 tempest-VolumesTestJSON-1937566554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:41:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-710c95ed-6b90-4ddf-8444-d43afc192852 tempest-VolumesTestJSON-1937566554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:41:57 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-710c95ed-6b90-4ddf-8444-d43afc192852 tempest-VolumesTestJSON-1937566554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:41:57 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-710c95ed-6b90-4ddf-8444-d43afc192852 tempest-VolumesTestJSON-1937566554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:41:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-710c95ed-6b90-4ddf-8444-d43afc192852 tempest-VolumesTestJSON-1937566554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:41:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-710c95ed-6b90-4ddf-8444-d43afc192852 tempest-VolumesTestJSON-1937566554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:57 devstack sudo[89945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:41:57 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:57 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4e3d71ac-5e6a-4c81-82a1-66469c004de7 tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96" returned: 0 in 0.761s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:57 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-4e3d71ac-5e6a-4c81-82a1-66469c004de7 tempest-VolumesSnapshotListTestJSON-1992088123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:41:57 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd2a55c-4b49-448a-8345-6f4e37a8fdb5]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4e3d71ac-5e6a-4c81-82a1-66469c004de7 tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:57 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca" returned: 0 in 0.792s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:57 devstack cinder-volume[84195]: DEBUG cinder.utils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Path /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-39997c9d-97dd-4ec7-8a75-2e563a3f1c39 not found in is_blk_device check {{(pid=84195) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 06:41:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-39997c9d-97dd-4ec7-8a75-2e563a3f1c39 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:57 devstack sudo[89948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-39997c9d-97dd-4ec7-8a75-2e563a3f1c39 Apr 29 06:41:57 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:57 devstack sudo[89947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c Apr 29 06:41:57 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:57 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-348745da-5643-4ac8-978c-589ffb0e4033 tempest-VolumesTestJSON-1937566554 None] Acquiring lock "cinder-2f1f3f81-fbfe-4fba-b2fb-55e70140a7e5-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:57 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-348745da-5643-4ac8-978c-589ffb0e4033 tempest-VolumesTestJSON-1937566554 None] Lock "cinder-2f1f3f81-fbfe-4fba-b2fb-55e70140a7e5-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:57 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-348745da-5643-4ac8-978c-589ffb0e4033 tempest-VolumesTestJSON-1937566554 None] Acquiring lock "cinder-quobyte-2f1f3f81-fbfe-4fba-b2fb-55e70140a7e5" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:41:57 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-348745da-5643-4ac8-978c-589ffb0e4033 tempest-VolumesTestJSON-1937566554 None] Lock "cinder-quobyte-2f1f3f81-fbfe-4fba-b2fb-55e70140a7e5" acquired by "delete_volume" :: waited 0.024s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:41:57 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff94d1b-f4ac-4cd9-8d52-bf3957073740]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:41:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-348745da-5643-4ac8-978c-589ffb0e4033 tempest-VolumesTestJSON-1937566554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-2f1f3f81-fbfe-4fba-b2fb-55e70140a7e5 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:57 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-710c95ed-6b90-4ddf-8444-d43afc192852 tempest-VolumesTestJSON-1937566554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.747s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:57 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-710c95ed-6b90-4ddf-8444-d43afc192852 tempest-VolumesTestJSON-1937566554 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:41:57 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-710c95ed-6b90-4ddf-8444-d43afc192852 tempest-VolumesTestJSON-1937566554 None] Deleted volume successfully. Apr 29 06:41:57 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-710c95ed-6b90-4ddf-8444-d43afc192852 tempest-VolumesTestJSON-1937566554 None] Lock "cinder-f23c0537-3626-478e-837a-e749aca6e705-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:41:58 devstack sudo[89955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-2f1f3f81-fbfe-4fba-b2fb-55e70140a7e5 Apr 29 06:41:58 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:58 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4e3d71ac-5e6a-4c81-82a1-66469c004de7 tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c" returned: 0 in 0.983s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4e3d71ac-5e6a-4c81-82a1-66469c004de7 tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:58 devstack sudo[89967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96 Apr 29 06:41:58 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:59 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-348745da-5643-4ac8-978c-589ffb0e4033 tempest-VolumesTestJSON-1937566554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-2f1f3f81-fbfe-4fba-b2fb-55e70140a7e5" returned: 0 in 1.507s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-348745da-5643-4ac8-978c-589ffb0e4033 tempest-VolumesTestJSON-1937566554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-2f1f3f81-fbfe-4fba-b2fb-55e70140a7e5 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:41:59 devstack sudo[89974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-2f1f3f81-fbfe-4fba-b2fb-55e70140a7e5 Apr 29 06:41:59 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:41:59 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root Apr 29 06:41:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4e3d71ac-5e6a-4c81-82a1-66469c004de7 tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96" returned: 0 in 1.726s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:41:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4e3d71ac-5e6a-4c81-82a1-66469c004de7 tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:00 devstack sudo[89979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96 Apr 29 06:42:00 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:00 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-348745da-5643-4ac8-978c-589ffb0e4033 tempest-VolumesTestJSON-1937566554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-2f1f3f81-fbfe-4fba-b2fb-55e70140a7e5" returned: 0 in 1.393s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-348745da-5643-4ac8-978c-589ffb0e4033 tempest-VolumesTestJSON-1937566554 None] Lock "cinder-quobyte-2f1f3f81-fbfe-4fba-b2fb-55e70140a7e5" released by "delete_volume" :: held 2.978s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:00 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-348745da-5643-4ac8-978c-589ffb0e4033 tempest-VolumesTestJSON-1937566554 None] Created reservations ['46049c86-ebce-42e8-b71b-61a0a4c93474', '76728c1d-ff1a-45eb-8b5c-9ec42fb5e0a3', 'b4683255-aea4-430a-8d95-476feeefedb2', '28c4cb9c-9d5c-4e56-98ac-6a6120fbdc1f'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:42:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-348745da-5643-4ac8-978c-589ffb0e4033 tempest-VolumesTestJSON-1937566554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-348745da-5643-4ac8-978c-589ffb0e4033 tempest-VolumesTestJSON-1937566554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:01 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-348745da-5643-4ac8-978c-589ffb0e4033 tempest-VolumesTestJSON-1937566554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:42:01 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-348745da-5643-4ac8-978c-589ffb0e4033 tempest-VolumesTestJSON-1937566554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:42:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-348745da-5643-4ac8-978c-589ffb0e4033 tempest-VolumesTestJSON-1937566554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-348745da-5643-4ac8-978c-589ffb0e4033 tempest-VolumesTestJSON-1937566554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:01 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:42:01 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:01 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4e3d71ac-5e6a-4c81-82a1-66469c004de7 tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c.341d061b-db6d-476f-b9f8-d9dc69642e96" returned: 0 in 1.850s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:01 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4e3d71ac-5e6a-4c81-82a1-66469c004de7 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "cinder-quobyte-341d061b-db6d-476f-b9f8-d9dc69642e96" released by "_delete_snapshot" :: held 5.522s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:01 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4e3d71ac-5e6a-4c81-82a1-66469c004de7 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "cinder-quobyte-c7b9e834-1a53-4048-a4df-71e13c1ea90c" released by "delete_snapshot" :: held 5.567s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:02 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-4e3d71ac-5e6a-4c81-82a1-66469c004de7 tempest-VolumesSnapshotListTestJSON-1992088123 None] Created reservations ['b4809227-322d-417e-bb4b-8f66fdebea39', '4cba8146-0214-428c-8aa2-f79852b7e0c9', '46aeefad-8fa6-4254-91b8-640bc098a971', '54d05382-3769-41d4-a0b9-84216710bf99'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:42:02 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-4e3d71ac-5e6a-4c81-82a1-66469c004de7 tempest-VolumesSnapshotListTestJSON-1992088123 None] Delete snapshot completed successfully. Apr 29 06:42:02 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4e3d71ac-5e6a-4c81-82a1-66469c004de7 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "cinder-341d061b-db6d-476f-b9f8-d9dc69642e96-delete_snapshot" released by "delete_snapshot" :: held 6.023s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:03 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-348745da-5643-4ac8-978c-589ffb0e4033 tempest-VolumesTestJSON-1937566554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 1.915s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:03 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-348745da-5643-4ac8-978c-589ffb0e4033 tempest-VolumesTestJSON-1937566554 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:42:03 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-348745da-5643-4ac8-978c-589ffb0e4033 tempest-VolumesTestJSON-1937566554 None] Deleted volume successfully. Apr 29 06:42:03 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-348745da-5643-4ac8-978c-589ffb0e4033 tempest-VolumesTestJSON-1937566554 None] Lock "cinder-2f1f3f81-fbfe-4fba-b2fb-55e70140a7e5-delete_volume" released by "delete_volume" :: held 5.351s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:03 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5cb41c92-7db8-42a7-9485-732b69bb2917 tempest-VolumesSnapshotListTestJSON-1992088123 None] Acquiring lock "cinder-c7b9e834-1a53-4048-a4df-71e13c1ea90c-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:03 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5cb41c92-7db8-42a7-9485-732b69bb2917 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "cinder-c7b9e834-1a53-4048-a4df-71e13c1ea90c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:03 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-39997c9d-97dd-4ec7-8a75-2e563a3f1c39" returned: 0 in 5.898s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:03 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d38a0fd-7fd9-4ea2-84ea-342b14f1dfe1]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:03 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5cb41c92-7db8-42a7-9485-732b69bb2917 tempest-VolumesSnapshotListTestJSON-1992088123 None] Acquiring lock "cinder-quobyte-c7b9e834-1a53-4048-a4df-71e13c1ea90c" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:03 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5cb41c92-7db8-42a7-9485-732b69bb2917 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "cinder-quobyte-c7b9e834-1a53-4048-a4df-71e13c1ea90c" acquired by "delete_volume" :: waited 0.019s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:03 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2e0ecd-5c3b-41c0-9c89-168ca4eea84e]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5cb41c92-7db8-42a7-9485-732b69bb2917 tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:03 devstack sudo[89986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca Apr 29 06:42:03 devstack sudo[89986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:03 devstack sudo[89987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c Apr 29 06:42:03 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:04 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5cb41c92-7db8-42a7-9485-732b69bb2917 tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c" returned: 0 in 0.832s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5cb41c92-7db8-42a7-9485-732b69bb2917 tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:04 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c Apr 29 06:42:04 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:04 devstack sudo[89986]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca" returned: 0 in 1.047s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:04 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Image conversion details: src /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca, size 1024.00 MB, duration 5.90 sec, destination /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-39997c9d-97dd-4ec7-8a75-2e563a3f1c39 {{(pid=84195) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 06:42:04 devstack cinder-volume[84195]: INFO cinder.image.image_utils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Converted 1024.00 MB image at 173.59 MB/s Apr 29 06:42:04 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-39997c9d-97dd-4ec7-8a75-2e563a3f1c39 is being set with open permissions: ugo+rw Apr 29 06:42:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-39997c9d-97dd-4ec7-8a75-2e563a3f1c39 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:04 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-39997c9d-97dd-4ec7-8a75-2e563a3f1c39 Apr 29 06:42:04 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:04 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5cb41c92-7db8-42a7-9485-732b69bb2917 tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c7b9e834-1a53-4048-a4df-71e13c1ea90c" returned: 0 in 0.649s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:04 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5cb41c92-7db8-42a7-9485-732b69bb2917 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "cinder-quobyte-c7b9e834-1a53-4048-a4df-71e13c1ea90c" released by "delete_volume" :: held 1.558s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:04 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-5cb41c92-7db8-42a7-9485-732b69bb2917 tempest-VolumesSnapshotListTestJSON-1992088123 None] Created reservations ['da619095-c2b6-4f59-8a18-03b71a0dde55', '1de0cc60-fb59-456c-b3c2-496712a0dbdf', 'dfc4fcf4-2c91-492a-9298-e011429ae4ff', '4d433835-d0a5-489f-9583-16157c3f67fe'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:42:04 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-39997c9d-97dd-4ec7-8a75-2e563a3f1c39" returned: 0 in 0.672s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5cb41c92-7db8-42a7-9485-732b69bb2917 tempest-VolumesSnapshotListTestJSON-1992088123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5cb41c92-7db8-42a7-9485-732b69bb2917 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5cb41c92-7db8-42a7-9485-732b69bb2917 tempest-VolumesSnapshotListTestJSON-1992088123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:42:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5cb41c92-7db8-42a7-9485-732b69bb2917 tempest-VolumesSnapshotListTestJSON-1992088123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:42:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5cb41c92-7db8-42a7-9485-732b69bb2917 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5cb41c92-7db8-42a7-9485-732b69bb2917 tempest-VolumesSnapshotListTestJSON-1992088123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:04 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Lock "cinder-quobyte-39997c9d-97dd-4ec7-8a75-2e563a3f1c39" released by "_copy_volume_from_snapshot" :: held 9.312s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:04 devstack sudo[90004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:42:04 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:04 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Acquiring lock "cinder-quobyte-50a2a827-5a72-43d2-a7fe-31253d058081" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:05 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Lock "cinder-quobyte-50a2a827-5a72-43d2-a7fe-31253d058081" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:05 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Deleting offline snapshot 50a2a827-5a72-43d2-a7fe-31253d058081 of volume 9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:42:05 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] snapshot_file for this snap is: volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.50a2a827-5a72-43d2-a7fe-31253d058081 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:42:05 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d1b851-a8e0-499f-a098-950c9156dff8]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.50a2a827-5a72-43d2-a7fe-31253d058081 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:05 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.50a2a827-5a72-43d2-a7fe-31253d058081 Apr 29 06:42:05 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:05 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5cb41c92-7db8-42a7-9485-732b69bb2917 tempest-VolumesSnapshotListTestJSON-1992088123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.698s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:05 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-5cb41c92-7db8-42a7-9485-732b69bb2917 tempest-VolumesSnapshotListTestJSON-1992088123 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:42:05 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-5cb41c92-7db8-42a7-9485-732b69bb2917 tempest-VolumesSnapshotListTestJSON-1992088123 None] Deleted volume successfully. Apr 29 06:42:05 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5cb41c92-7db8-42a7-9485-732b69bb2917 tempest-VolumesSnapshotListTestJSON-1992088123 None] Lock "cinder-c7b9e834-1a53-4048-a4df-71e13c1ea90c-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:05 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.50a2a827-5a72-43d2-a7fe-31253d058081" returned: 0 in 0.835s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:05 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:42:05 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ac332d-293a-4923-bfc7-a8a1ea7b6456]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:06 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca Apr 29 06:42:06 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:06 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca" returned: 0 in 0.852s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.50a2a827-5a72-43d2-a7fe-31253d058081 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:06 devstack sudo[90018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.50a2a827-5a72-43d2-a7fe-31253d058081 Apr 29 06:42:06 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:07 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.50a2a827-5a72-43d2-a7fe-31253d058081" returned: 0 in 0.797s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.50a2a827-5a72-43d2-a7fe-31253d058081 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:07 devstack sudo[90023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.50a2a827-5a72-43d2-a7fe-31253d058081 Apr 29 06:42:07 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:08 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca.50a2a827-5a72-43d2-a7fe-31253d058081" returned: 0 in 0.671s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Lock "cinder-quobyte-50a2a827-5a72-43d2-a7fe-31253d058081" released by "_delete_snapshot" :: held 3.277s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.277s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.033s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5f04b6ac-10e4-42b8-ae16-365cad873a63,created_at=2026-04-29T04:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1249952215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5f04b6ac-10e4-42b8-ae16-365cad873a63,host='devstack@QuobyteHD#QuobyteHD',id=a5577d1c-295f-4fb0-80e2-526d4f878b94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d9e7b170394e1093075e88f3deb2fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:41:51Z,use_quota=True,user_id='5ebe735b9fb04d90a78dc3c973080675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42ab2582-daef-42f4-966d-e94f17c0d710),volume_type_id=42ab2582-daef-42f4-966d-e94f17c0d710)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Creating volume a5577d1c-295f-4fb0-80e2-526d4f878b94 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:42:08 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ed5001-0f2e-4117-a94f-28501a6bebe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39997c9d-97dd-4ec7-8a75-2e563a3f1c39', 'volume_size': 1, 'source_volid': '9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca', 'source_volstatus': 'available'}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e979114-c4fa-4aa1-b635-e92b9c977d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:08 devstack sudo[90026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94 1073741824 Apr 29 06:42:08 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:08 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Volume volume-39997c9d-97dd-4ec7-8a75-2e563a3f1c39 (39997c9d-97dd-4ec7-8a75-2e563a3f1c39): created successfully Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e979114-c4fa-4aa1-b635-e92b9c977d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Flow 'volume_create_manager' (f29661ff-5405-487d-80e0-2168eb88b565) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:42:08 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-0a6fb1c3-8ce9-4fa7-80e5-9de4294bdaef tempest-VolumesGetTest-1294989752 None] Created volume successfully. Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Flow 'volume_create_manager' (046f7e25-56b9-460f-90fe-8d3503bef14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e89d29a-4080-4141-a91c-0cf25ed0351c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e89d29a-4080-4141-a91c-0cf25ed0351c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-753732720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=659f7b2b-87d1-45de-a61a-2208cdee18ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='445722a236324a2bb2675a3515ac7e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:42:09Z,use_quota=True,user_id='ff6002124d814957b384c69d817ba159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd431cfc-73e3-4a57-86bd-c01cfe150f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd431cfc-73e3-4a57-86bd-c01cfe150f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8cf022-ee16-438d-8acc-c92febf701f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8cf022-ee16-438d-8acc-c92febf701f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '659f7b2b-87d1-45de-a61a-2208cdee18ab', 'volume_name': 'volume-659f7b2b-87d1-45de-a61a-2208cdee18ab', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb927c09-e89c-40da-90d6-2a092ee89efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb927c09-e89c-40da-90d6-2a092ee89efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf31bd3a-108f-4f5d-9304-b327b2a06e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:08 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Volume 659f7b2b-87d1-45de-a61a-2208cdee18ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-659f7b2b-87d1-45de-a61a-2208cdee18ab', 'volume_size': 1} Apr 29 06:42:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:09 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:42:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Flow 'volume_create_manager' (b4920947-b588-461d-be1b-a6c471926591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:42:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a431c0a-613a-49f4-b2e6-5d130e1af0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:09 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94 1073741824" returned: 0 in 1.114s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a431c0a-613a-49f4-b2e6-5d130e1af0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1001319067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98239649-03bc-47e8-9d1a-f9d15b635d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='445722a236324a2bb2675a3515ac7e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:42:09Z,use_quota=True,user_id='ff6002124d814957b384c69d817ba159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc38d375-207f-4695-be03-db875af5f174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc38d375-207f-4695-be03-db875af5f174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd80e73a-f7f2-4cad-8bbb-dfc660ebf5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd80e73a-f7f2-4cad-8bbb-dfc660ebf5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98239649-03bc-47e8-9d1a-f9d15b635d61', 'volume_name': 'volume-98239649-03bc-47e8-9d1a-f9d15b635d61', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687b0380-4324-4554-9e95-07ddb0bc5de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687b0380-4324-4554-9e95-07ddb0bc5de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d363ac-d441-4c89-9a0d-eb0f366c0e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:09 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Volume 98239649-03bc-47e8-9d1a-f9d15b635d61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98239649-03bc-47e8-9d1a-f9d15b635d61', 'volume_size': 1} Apr 29 06:42:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:09 devstack sudo[90032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94 Apr 29 06:42:09 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Flow 'volume_create_manager' (0eca3167-1f42-4ea2-8f79-13a1e4bb6bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a7e925-cdfb-4ab1-a7ac-0fa424689cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a7e925-cdfb-4ab1-a7ac-0fa424689cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1333654653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91c357b4-ede9-433e-9a6c-1af335d18c18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='445722a236324a2bb2675a3515ac7e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:42:10Z,use_quota=True,user_id='ff6002124d814957b384c69d817ba159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b291088-032b-41eb-ad56-1f67ef24918b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b291088-032b-41eb-ad56-1f67ef24918b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0f6223-23d6-4ac1-b943-274d9e71114b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0f6223-23d6-4ac1-b943-274d9e71114b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91c357b4-ede9-433e-9a6c-1af335d18c18', 'volume_name': 'volume-91c357b4-ede9-433e-9a6c-1af335d18c18', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c02b27-16e1-469b-a945-6674fea79204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c02b27-16e1-469b-a945-6674fea79204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20512644-f887-4c6e-8628-48ce5368f730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:10 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Volume 91c357b4-ede9-433e-9a6c-1af335d18c18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91c357b4-ede9-433e-9a6c-1af335d18c18', 'volume_size': 1} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Flow 'volume_create_manager' (ebd34dcf-26f9-4d70-8997-4292976bcdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db771683-3e4a-4604-abcc-be42f6cebb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db771683-3e4a-4604-abcc-be42f6cebb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:42:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1550708734',display_name='tempest-VolumesGetTest-Volume-922802434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65045c34-ddbd-48aa-a972-2083f3c6ef90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de093ceebc784c93b0b02e0c89978247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:42:10Z,use_quota=True,user_id='46456f53c8ca414a88ce4258a59158ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edcae247-e9b9-4c4d-a404-62a6b309b712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edcae247-e9b9-4c4d-a404-62a6b309b712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab45f97-8f66-42fe-b631-c582665bdaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab45f97-8f66-42fe-b631-c582665bdaa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65045c34-ddbd-48aa-a972-2083f3c6ef90', 'volume_name': 'volume-65045c34-ddbd-48aa-a972-2083f3c6ef90', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b5e1c9-9af3-4dfe-8fb6-281f84e7a54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b5e1c9-9af3-4dfe-8fb6-281f84e7a54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80410f2f-d6d9-4696-8999-597c7c5df688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:10 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Volume 65045c34-ddbd-48aa-a972-2083f3c6ef90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65045c34-ddbd-48aa-a972-2083f3c6ef90', 'volume_size': 1} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:42:10 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Flow 'volume_create_manager' (77a9e893-1a39-4aee-8ad4-c966f05d9491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d64695f-defa-4ef9-935e-34e92000b597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94" returned: 0 in 0.871s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] <== create_volume: return (2114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.119s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.469s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-753732720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=659f7b2b-87d1-45de-a61a-2208cdee18ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='445722a236324a2bb2675a3515ac7e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:42:09Z,use_quota=True,user_id='ff6002124d814957b384c69d817ba159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Creating volume 659f7b2b-87d1-45de-a61a-2208cdee18ab {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:42:10 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-659f7b2b-87d1-45de-a61a-2208cdee18ab 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d64695f-defa-4ef9-935e-34e92000b597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2088487601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f3f55d6-e83a-4f08-b0a1-ffd7303c5ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='445722a236324a2bb2675a3515ac7e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:42:10Z,use_quota=True,user_id='ff6002124d814957b384c69d817ba159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe87555-46b0-4071-a3c3-d69744c73bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:10 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-659f7b2b-87d1-45de-a61a-2208cdee18ab 1073741824 Apr 29 06:42:10 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe87555-46b0-4071-a3c3-d69744c73bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (accdd721-06c3-455d-a9ce-177dfced9de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (accdd721-06c3-455d-a9ce-177dfced9de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f3f55d6-e83a-4f08-b0a1-ffd7303c5ab7', 'volume_name': 'volume-3f3f55d6-e83a-4f08-b0a1-ffd7303c5ab7', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724690f9-dcc3-4720-a1fd-8c06d728263e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724690f9-dcc3-4720-a1fd-8c06d728263e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5663118-35cb-4319-ba23-273c181ed82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:10 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Volume 3f3f55d6-e83a-4f08-b0a1-ffd7303c5ab7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f3f55d6-e83a-4f08-b0a1-ffd7303c5ab7', 'volume_size': 1} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3511adcc-017d-4fcc-a36b-7238b99eab43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5577d1c-295f-4fb0-80e2-526d4f878b94', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2244fde-a98b-4b57-8f4b-bd289239e970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:10 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Volume volume-a5577d1c-295f-4fb0-80e2-526d4f878b94 (a5577d1c-295f-4fb0-80e2-526d4f878b94): created successfully Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2244fde-a98b-4b57-8f4b-bd289239e970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Flow 'volume_create_manager' (78bbd5dd-8f83-4c6b-93b9-6e7516909108) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:42:10 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-85e38c28-ec18-4c09-be5e-2ef1e980efc3 tempest-GroupSnapshotsTest-841847317 None] Created volume successfully. Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Flow 'volume_create_manager' (a0410ce0-e0dc-4976-8d59-1382ef6b453b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28111bfa-c2ae-45ea-8233-5e7a3d6a039a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28111bfa-c2ae-45ea-8233-5e7a3d6a039a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-578874632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=502465bb-c80d-4725-9e9f-559f1e1e2293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='445722a236324a2bb2675a3515ac7e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:42:11Z,use_quota=True,user_id='ff6002124d814957b384c69d817ba159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a895dfbd-6f00-4b5e-aa82-400768b964ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a895dfbd-6f00-4b5e-aa82-400768b964ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d46d6e-8835-467d-b5db-876b4a6262ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d46d6e-8835-467d-b5db-876b4a6262ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '502465bb-c80d-4725-9e9f-559f1e1e2293', 'volume_name': 'volume-502465bb-c80d-4725-9e9f-559f1e1e2293', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4116a63-5b64-43bd-8104-5fca2c49d09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4116a63-5b64-43bd-8104-5fca2c49d09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (203054e9-784d-4d22-9b66-8d2a28fda3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:10 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Volume 502465bb-c80d-4725-9e9f-559f1e1e2293: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-502465bb-c80d-4725-9e9f-559f1e1e2293', 'volume_size': 1} Apr 29 06:42:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:11 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-fa6abe8b-e534-4e28-aaa0-2a593d822247 tempest-GroupSnapshotsTest-841847317 None] Update group completed successfully. Apr 29 06:42:11 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-659f7b2b-87d1-45de-a61a-2208cdee18ab 1073741824" returned: 0 in 0.902s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-659f7b2b-87d1-45de-a61a-2208cdee18ab {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:11 devstack sudo[90041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-659f7b2b-87d1-45de-a61a-2208cdee18ab Apr 29 06:42:11 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:12 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-659f7b2b-87d1-45de-a61a-2208cdee18ab" returned: 0 in 0.648s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:12 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:42:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.518s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:12 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1001319067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98239649-03bc-47e8-9d1a-f9d15b635d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='445722a236324a2bb2675a3515ac7e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:42:09Z,use_quota=True,user_id='ff6002124d814957b384c69d817ba159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:42:12 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Creating volume 98239649-03bc-47e8-9d1a-f9d15b635d61 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:42:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:12 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:42:12 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:42:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:12 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:42:12 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:42:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-98239649-03bc-47e8-9d1a-f9d15b635d61 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:12 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-98239649-03bc-47e8-9d1a-f9d15b635d61 1073741824 Apr 29 06:42:12 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:12 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf31bd3a-108f-4f5d-9304-b327b2a06e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-659f7b2b-87d1-45de-a61a-2208cdee18ab', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:12 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19b30ea7-5b00-411e-8bb0-4ce98500c3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:12 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Volume volume-659f7b2b-87d1-45de-a61a-2208cdee18ab (659f7b2b-87d1-45de-a61a-2208cdee18ab): created successfully Apr 29 06:42:12 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19b30ea7-5b00-411e-8bb0-4ce98500c3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:12 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Flow 'volume_create_manager' (046f7e25-56b9-460f-90fe-8d3503bef14e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:42:12 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-266c436e-fc12-465a-b84b-399dadb82a30 tempest-CreateVolumesFromImageTest-1319999963 None] Created volume successfully. Apr 29 06:42:12 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-1fce47bb-2018-4d84-a32b-3be053dea00f tempest-GroupSnapshotsTest-841847317 None] Update group completed successfully. Apr 29 06:42:12 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-98239649-03bc-47e8-9d1a-f9d15b635d61 1073741824" returned: 0 in 0.884s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-98239649-03bc-47e8-9d1a-f9d15b635d61 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:13 devstack sudo[90050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-98239649-03bc-47e8-9d1a-f9d15b635d61 Apr 29 06:42:13 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:13 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-47e9932b-20cb-49a6-8da6-e2c5a324a224 tempest-GroupSnapshotsTest-841847317 None] Update group completed successfully. Apr 29 06:42:13 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-98239649-03bc-47e8-9d1a-f9d15b635d61" returned: 0 in 0.706s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:13 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:42:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.524s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:13 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1333654653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91c357b4-ede9-433e-9a6c-1af335d18c18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='445722a236324a2bb2675a3515ac7e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:42:10Z,use_quota=True,user_id='ff6002124d814957b384c69d817ba159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:42:13 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Creating volume 91c357b4-ede9-433e-9a6c-1af335d18c18 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:42:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:13 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:42:13 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:42:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:13 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:42:13 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:42:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-91c357b4-ede9-433e-9a6c-1af335d18c18 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:13 devstack sudo[90053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-91c357b4-ede9-433e-9a6c-1af335d18c18 1073741824 Apr 29 06:42:13 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:13 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d363ac-d441-4c89-9a0d-eb0f366c0e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98239649-03bc-47e8-9d1a-f9d15b635d61', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:13 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314b7c41-c515-47cc-869d-7840c5b76497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:13 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Volume volume-98239649-03bc-47e8-9d1a-f9d15b635d61 (98239649-03bc-47e8-9d1a-f9d15b635d61): created successfully Apr 29 06:42:13 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314b7c41-c515-47cc-869d-7840c5b76497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:13 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Flow 'volume_create_manager' (b4920947-b588-461d-be1b-a6c471926591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:42:13 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-3bbb7ad5-1a47-4c2d-befd-65299fd053c2 tempest-CreateVolumesFromImageTest-1319999963 None] Created volume successfully. Apr 29 06:42:14 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-91c357b4-ede9-433e-9a6c-1af335d18c18 1073741824" returned: 0 in 0.857s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-91c357b4-ede9-433e-9a6c-1af335d18c18 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:14 devstack sudo[90060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-91c357b4-ede9-433e-9a6c-1af335d18c18 Apr 29 06:42:14 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:14 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-4992c2be-8342-44e5-8479-9160edae9afb tempest-GroupSnapshotsTest-841847317 None] Update group completed successfully. Apr 29 06:42:15 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-91c357b4-ede9-433e-9a6c-1af335d18c18" returned: 0 in 0.697s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:15 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:42:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.029s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:15 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:42:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1550708734',display_name='tempest-VolumesGetTest-Volume-922802434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65045c34-ddbd-48aa-a972-2083f3c6ef90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de093ceebc784c93b0b02e0c89978247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:42:10Z,use_quota=True,user_id='46456f53c8ca414a88ce4258a59158ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:42:15 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Creating volume 65045c34-ddbd-48aa-a972-2083f3c6ef90 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:42:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:15 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:42:15 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:42:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:15 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:42:15 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:42:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-65045c34-ddbd-48aa-a972-2083f3c6ef90 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:15 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20512644-f887-4c6e-8628-48ce5368f730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91c357b4-ede9-433e-9a6c-1af335d18c18', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:15 devstack sudo[90063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-65045c34-ddbd-48aa-a972-2083f3c6ef90 1073741824 Apr 29 06:42:15 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:15 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12da632b-e61d-4c9e-a530-97b4915e147e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:15 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Volume volume-91c357b4-ede9-433e-9a6c-1af335d18c18 (91c357b4-ede9-433e-9a6c-1af335d18c18): created successfully Apr 29 06:42:15 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12da632b-e61d-4c9e-a530-97b4915e147e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:15 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Flow 'volume_create_manager' (0eca3167-1f42-4ea2-8f79-13a1e4bb6bca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:42:15 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:INSERT=29,cinder:UPDATE=162,cinder:SELECT=139,cinder:DELETE=11 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:42:15 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-6140e6f3-ad07-4507-b109-109e7add3755 tempest-CreateVolumesFromImageTest-1319999963 None] Created volume successfully. Apr 29 06:42:16 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] GroupSnapshot 2f7a612e-0bda-49b9-aa01-51feb3ad8d5f: creating. Apr 29 06:42:16 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] Group snapshot 2f7a612e-0bda-49b9-aa01-51feb3ad8d5f: creating. {{(pid=84195) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 06:42:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:16 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-65045c34-ddbd-48aa-a972-2083f3c6ef90 1073741824" returned: 0 in 1.025s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-65045c34-ddbd-48aa-a972-2083f3c6ef90 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:16 devstack sudo[90071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-65045c34-ddbd-48aa-a972-2083f3c6ef90 Apr 29 06:42:16 devstack sudo[90071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:16 devstack sudo[90071]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-65045c34-ddbd-48aa-a972-2083f3c6ef90" returned: 0 in 0.594s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:16 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:42:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.444s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:16 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2088487601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f3f55d6-e83a-4f08-b0a1-ffd7303c5ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='445722a236324a2bb2675a3515ac7e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:42:10Z,use_quota=True,user_id='ff6002124d814957b384c69d817ba159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:42:16 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Creating volume 3f3f55d6-e83a-4f08-b0a1-ffd7303c5ab7 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:42:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:16 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:42:16 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:42:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:16 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:42:16 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:42:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3f3f55d6-e83a-4f08-b0a1-ffd7303c5ab7 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80410f2f-d6d9-4696-8999-597c7c5df688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65045c34-ddbd-48aa-a972-2083f3c6ef90', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:17 devstack sudo[90074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3f3f55d6-e83a-4f08-b0a1-ffd7303c5ab7 1073741824 Apr 29 06:42:17 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f8be7f-5952-43b6-9983-de1fb8ecacc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:17 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:SELECT=123,cinder:UPDATE=141,cinder:DELETE=12,cinder:INSERT=40 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:42:17 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Volume volume-65045c34-ddbd-48aa-a972-2083f3c6ef90 (65045c34-ddbd-48aa-a972-2083f3c6ef90): created successfully Apr 29 06:42:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f8be7f-5952-43b6-9983-de1fb8ecacc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Flow 'volume_create_manager' (ebd34dcf-26f9-4d70-8997-4292976bcdea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:42:17 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-1b59bcc9-1fc0-4012-a85e-70a80fbc8d93 tempest-VolumesGetTest-1294989752 None] Created volume successfully. Apr 29 06:42:17 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-78084766-1471-4e53-b35b-e54d58785e46 tempest-VolumesGetTest-1294989752 None] Acquiring lock "cinder-65045c34-ddbd-48aa-a972-2083f3c6ef90-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:17 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-78084766-1471-4e53-b35b-e54d58785e46 tempest-VolumesGetTest-1294989752 None] Lock "cinder-65045c34-ddbd-48aa-a972-2083f3c6ef90-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:17 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-78084766-1471-4e53-b35b-e54d58785e46 tempest-VolumesGetTest-1294989752 None] Acquiring lock "cinder-quobyte-65045c34-ddbd-48aa-a972-2083f3c6ef90" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:17 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-78084766-1471-4e53-b35b-e54d58785e46 tempest-VolumesGetTest-1294989752 None] Lock "cinder-quobyte-65045c34-ddbd-48aa-a972-2083f3c6ef90" acquired by "delete_volume" :: waited 0.020s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:17 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f6bf23-ab07-4f95-97a1-a8d4de40fad9]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-78084766-1471-4e53-b35b-e54d58785e46 tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-65045c34-ddbd-48aa-a972-2083f3c6ef90 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:17 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-65045c34-ddbd-48aa-a972-2083f3c6ef90 Apr 29 06:42:17 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:17 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3f3f55d6-e83a-4f08-b0a1-ffd7303c5ab7 1073741824" returned: 0 in 0.954s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3f3f55d6-e83a-4f08-b0a1-ffd7303c5ab7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:18 devstack sudo[90082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3f3f55d6-e83a-4f08-b0a1-ffd7303c5ab7 Apr 29 06:42:18 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:18 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-78084766-1471-4e53-b35b-e54d58785e46 tempest-VolumesGetTest-1294989752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-65045c34-ddbd-48aa-a972-2083f3c6ef90" returned: 0 in 0.801s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-78084766-1471-4e53-b35b-e54d58785e46 tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-65045c34-ddbd-48aa-a972-2083f3c6ef90 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:18 devstack sudo[90088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-65045c34-ddbd-48aa-a972-2083f3c6ef90 Apr 29 06:42:18 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:18 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3f3f55d6-e83a-4f08-b0a1-ffd7303c5ab7" returned: 0 in 0.649s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:42:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.664s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-578874632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=502465bb-c80d-4725-9e9f-559f1e1e2293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='445722a236324a2bb2675a3515ac7e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:42:11Z,use_quota=True,user_id='ff6002124d814957b384c69d817ba159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:42:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Creating volume 502465bb-c80d-4725-9e9f-559f1e1e2293 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:42:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:42:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:42:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:42:18 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:42:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-502465bb-c80d-4725-9e9f-559f1e1e2293 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5663118-35cb-4319-ba23-273c181ed82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f3f55d6-e83a-4f08-b0a1-ffd7303c5ab7', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:18 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-502465bb-c80d-4725-9e9f-559f1e1e2293 1073741824 Apr 29 06:42:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca21ab7-f7c6-48c0-945b-116d7f52c9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:18 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:18 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Volume volume-3f3f55d6-e83a-4f08-b0a1-ffd7303c5ab7 (3f3f55d6-e83a-4f08-b0a1-ffd7303c5ab7): created successfully Apr 29 06:42:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca21ab7-f7c6-48c0-945b-116d7f52c9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Flow 'volume_create_manager' (77a9e893-1a39-4aee-8ad4-c966f05d9491) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:42:18 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-214ec60d-a391-4e6e-a1c2-315eb4c94ea5 tempest-CreateVolumesFromImageTest-1319999963 None] Created volume successfully. Apr 29 06:42:19 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-78084766-1471-4e53-b35b-e54d58785e46 tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-65045c34-ddbd-48aa-a972-2083f3c6ef90" returned: 0 in 0.747s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:19 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-78084766-1471-4e53-b35b-e54d58785e46 tempest-VolumesGetTest-1294989752 None] Lock "cinder-quobyte-65045c34-ddbd-48aa-a972-2083f3c6ef90" released by "delete_volume" :: held 1.604s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:19 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-78084766-1471-4e53-b35b-e54d58785e46 tempest-VolumesGetTest-1294989752 None] Created reservations ['faed8676-de94-4ea8-a2e5-2822467458f5', '34209472-7cba-4abf-86c6-bb2034c6e189', '26633954-5f07-4cc3-85a2-f599c21fc53e', '67a5c9d9-66fb-4fd6-9974-0d0b8993ff50'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:42:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-78084766-1471-4e53-b35b-e54d58785e46 tempest-VolumesGetTest-1294989752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-78084766-1471-4e53-b35b-e54d58785e46 tempest-VolumesGetTest-1294989752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:19 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-78084766-1471-4e53-b35b-e54d58785e46 tempest-VolumesGetTest-1294989752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:42:19 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-78084766-1471-4e53-b35b-e54d58785e46 tempest-VolumesGetTest-1294989752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:42:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-78084766-1471-4e53-b35b-e54d58785e46 tempest-VolumesGetTest-1294989752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-78084766-1471-4e53-b35b-e54d58785e46 tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:19 devstack sudo[90096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:42:19 devstack sudo[90096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:19 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-502465bb-c80d-4725-9e9f-559f1e1e2293 1073741824" returned: 0 in 0.995s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-502465bb-c80d-4725-9e9f-559f1e1e2293 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:19 devstack sudo[90098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-502465bb-c80d-4725-9e9f-559f1e1e2293 Apr 29 06:42:19 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:20 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-450d9763-6e09-4060-a979-b32a083abdd4 tempest-VolumesGetTest-1294989752 None] Acquiring lock "cinder-39997c9d-97dd-4ec7-8a75-2e563a3f1c39-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:20 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-450d9763-6e09-4060-a979-b32a083abdd4 tempest-VolumesGetTest-1294989752 None] Lock "cinder-39997c9d-97dd-4ec7-8a75-2e563a3f1c39-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:20 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-450d9763-6e09-4060-a979-b32a083abdd4 tempest-VolumesGetTest-1294989752 None] Acquiring lock "cinder-quobyte-39997c9d-97dd-4ec7-8a75-2e563a3f1c39" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:20 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-450d9763-6e09-4060-a979-b32a083abdd4 tempest-VolumesGetTest-1294989752 None] Lock "cinder-quobyte-39997c9d-97dd-4ec7-8a75-2e563a3f1c39" acquired by "delete_volume" :: waited 0.020s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:20 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43b5d67-6c48-4bb5-890c-b74f0f0fd074]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-450d9763-6e09-4060-a979-b32a083abdd4 tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-39997c9d-97dd-4ec7-8a75-2e563a3f1c39 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:20 devstack sudo[90101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-39997c9d-97dd-4ec7-8a75-2e563a3f1c39 Apr 29 06:42:20 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:20 devstack sudo[90096]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-78084766-1471-4e53-b35b-e54d58785e46 tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.769s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:20 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-78084766-1471-4e53-b35b-e54d58785e46 tempest-VolumesGetTest-1294989752 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:42:20 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-78084766-1471-4e53-b35b-e54d58785e46 tempest-VolumesGetTest-1294989752 None] Deleted volume successfully. Apr 29 06:42:20 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-78084766-1471-4e53-b35b-e54d58785e46 tempest-VolumesGetTest-1294989752 None] Lock "cinder-65045c34-ddbd-48aa-a972-2083f3c6ef90-delete_volume" released by "delete_volume" :: held 2.654s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:20 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-502465bb-c80d-4725-9e9f-559f1e1e2293" returned: 0 in 0.687s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:42:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.098s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (203054e9-784d-4d22-9b66-8d2a28fda3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-502465bb-c80d-4725-9e9f-559f1e1e2293', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (551a2458-8660-4397-a6c4-24c7211947ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] Creating offline snapshot 7da5db2b-5055-4dc3-99d3-acb28157182e of volume a5577d1c-295f-4fb0-80e2-526d4f878b94 {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:42:20 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Volume volume-502465bb-c80d-4725-9e9f-559f1e1e2293 (502465bb-c80d-4725-9e9f-559f1e1e2293): created successfully Apr 29 06:42:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (551a2458-8660-4397-a6c4-24c7211947ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Flow 'volume_create_manager' (a0410ce0-e0dc-4976-8d59-1382ef6b453b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:42:20 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[440106e6-b548-4733-9bcf-ddc553289d5a]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:20 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-d1b1a35b-7132-416f-b79c-63756904ff91 tempest-CreateVolumesFromImageTest-1319999963 None] Created volume successfully. Apr 29 06:42:20 devstack sudo[90104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94 Apr 29 06:42:20 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:20 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-d2f7ffd6-8d28-458e-a10a-39c2d52b55e4 tempest-CreateVolumesFromImageTest-1319999963 None] Acquiring lock "cinder-502465bb-c80d-4725-9e9f-559f1e1e2293-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:20 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-d2f7ffd6-8d28-458e-a10a-39c2d52b55e4 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "cinder-502465bb-c80d-4725-9e9f-559f1e1e2293-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:20 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-d2f7ffd6-8d28-458e-a10a-39c2d52b55e4 tempest-CreateVolumesFromImageTest-1319999963 None] Acquiring lock "cinder-quobyte-502465bb-c80d-4725-9e9f-559f1e1e2293" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:20 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-d2f7ffd6-8d28-458e-a10a-39c2d52b55e4 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "cinder-quobyte-502465bb-c80d-4725-9e9f-559f1e1e2293" acquired by "delete_volume" :: waited 0.032s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:20 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e1a373-5701-4904-9a8d-227aad3babc9]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d2f7ffd6-8d28-458e-a10a-39c2d52b55e4 tempest-CreateVolumesFromImageTest-1319999963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-502465bb-c80d-4725-9e9f-559f1e1e2293 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:21 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-450d9763-6e09-4060-a979-b32a083abdd4 tempest-VolumesGetTest-1294989752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-39997c9d-97dd-4ec7-8a75-2e563a3f1c39" returned: 0 in 0.950s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-450d9763-6e09-4060-a979-b32a083abdd4 tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-39997c9d-97dd-4ec7-8a75-2e563a3f1c39 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:21 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-502465bb-c80d-4725-9e9f-559f1e1e2293 Apr 29 06:42:21 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:21 devstack sudo[90110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-39997c9d-97dd-4ec7-8a75-2e563a3f1c39 Apr 29 06:42:21 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:21 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94" returned: 0 in 1.055s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94.7da5db2b-5055-4dc3-99d3-acb28157182e 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:21 devstack sudo[90117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94.7da5db2b-5055-4dc3-99d3-acb28157182e 1G Apr 29 06:42:21 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:21 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:21 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d2f7ffd6-8d28-458e-a10a-39c2d52b55e4 tempest-CreateVolumesFromImageTest-1319999963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-502465bb-c80d-4725-9e9f-559f1e1e2293" returned: 0 in 0.888s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d2f7ffd6-8d28-458e-a10a-39c2d52b55e4 tempest-CreateVolumesFromImageTest-1319999963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-502465bb-c80d-4725-9e9f-559f1e1e2293 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-450d9763-6e09-4060-a979-b32a083abdd4 tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-39997c9d-97dd-4ec7-8a75-2e563a3f1c39" returned: 0 in 0.798s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:21 devstack sudo[90123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-502465bb-c80d-4725-9e9f-559f1e1e2293 Apr 29 06:42:21 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-450d9763-6e09-4060-a979-b32a083abdd4 tempest-VolumesGetTest-1294989752 None] Lock "cinder-quobyte-39997c9d-97dd-4ec7-8a75-2e563a3f1c39" released by "delete_volume" :: held 1.811s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:22 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-450d9763-6e09-4060-a979-b32a083abdd4 tempest-VolumesGetTest-1294989752 None] Created reservations ['7bb207f0-e31d-452e-9e50-fa1f4c973316', '85fb5b5c-ab9b-488c-84b1-55f8d9cba48b', '897184a8-8524-4e1e-b351-3f843be99f75', '80007e3b-d157-48e6-a9f1-81bf9e0fe746'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:42:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-450d9763-6e09-4060-a979-b32a083abdd4 tempest-VolumesGetTest-1294989752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-450d9763-6e09-4060-a979-b32a083abdd4 tempest-VolumesGetTest-1294989752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-450d9763-6e09-4060-a979-b32a083abdd4 tempest-VolumesGetTest-1294989752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:42:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-450d9763-6e09-4060-a979-b32a083abdd4 tempest-VolumesGetTest-1294989752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:42:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-450d9763-6e09-4060-a979-b32a083abdd4 tempest-VolumesGetTest-1294989752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-450d9763-6e09-4060-a979-b32a083abdd4 tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:22 devstack sudo[90127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:42:22 devstack sudo[90127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:22 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94.7da5db2b-5055-4dc3-99d3-acb28157182e 1G" returned: 0 in 1.001s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5577d1c-295f-4fb0-80e2-526d4f878b94 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94.7da5db2b-5055-4dc3-99d3-acb28157182e {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:22 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9b79e221-34ab-4a81-b5ca-f20c5a5f3865 tempest-VolumesGetTest-1294989752 None] Acquiring lock "cinder-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:22 devstack sudo[90145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5577d1c-295f-4fb0-80e2-526d4f878b94 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94.7da5db2b-5055-4dc3-99d3-acb28157182e Apr 29 06:42:22 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:22 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9b79e221-34ab-4a81-b5ca-f20c5a5f3865 tempest-VolumesGetTest-1294989752 None] Lock "cinder-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:22 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9b79e221-34ab-4a81-b5ca-f20c5a5f3865 tempest-VolumesGetTest-1294989752 None] Acquiring lock "cinder-quobyte-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:22 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9b79e221-34ab-4a81-b5ca-f20c5a5f3865 tempest-VolumesGetTest-1294989752 None] Lock "cinder-quobyte-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca" acquired by "delete_volume" :: waited 0.030s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:22 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf00d02-33fb-4b3f-aa1f-fc6e783048d4]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9b79e221-34ab-4a81-b5ca-f20c5a5f3865 tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:22 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d2f7ffd6-8d28-458e-a10a-39c2d52b55e4 tempest-CreateVolumesFromImageTest-1319999963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-502465bb-c80d-4725-9e9f-559f1e1e2293" returned: 0 in 0.985s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:22 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-d2f7ffd6-8d28-458e-a10a-39c2d52b55e4 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "cinder-quobyte-502465bb-c80d-4725-9e9f-559f1e1e2293" released by "delete_volume" :: held 1.933s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:22 devstack sudo[90168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca Apr 29 06:42:22 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:22 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-d2f7ffd6-8d28-458e-a10a-39c2d52b55e4 tempest-CreateVolumesFromImageTest-1319999963 None] Created reservations ['84281f44-3f5f-41d1-b14c-82555167a92d', 'ab73dfe5-3ce0-4b81-8112-c7748840fb36', '096d9cb6-5e9f-46d0-b45a-b1d560def165', '26822bcf-28a5-4ed6-8b9f-1fe42e84320d'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:42:23 devstack sudo[90127]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-450d9763-6e09-4060-a979-b32a083abdd4 tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.885s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:23 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-450d9763-6e09-4060-a979-b32a083abdd4 tempest-VolumesGetTest-1294989752 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:42:23 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-450d9763-6e09-4060-a979-b32a083abdd4 tempest-VolumesGetTest-1294989752 None] Deleted volume successfully. Apr 29 06:42:23 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-450d9763-6e09-4060-a979-b32a083abdd4 tempest-VolumesGetTest-1294989752 None] Lock "cinder-39997c9d-97dd-4ec7-8a75-2e563a3f1c39-delete_volume" released by "delete_volume" :: held 3.034s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d2f7ffd6-8d28-458e-a10a-39c2d52b55e4 tempest-CreateVolumesFromImageTest-1319999963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d2f7ffd6-8d28-458e-a10a-39c2d52b55e4 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:23 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d2f7ffd6-8d28-458e-a10a-39c2d52b55e4 tempest-CreateVolumesFromImageTest-1319999963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:42:23 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d2f7ffd6-8d28-458e-a10a-39c2d52b55e4 tempest-CreateVolumesFromImageTest-1319999963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:42:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d2f7ffd6-8d28-458e-a10a-39c2d52b55e4 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d2f7ffd6-8d28-458e-a10a-39c2d52b55e4 tempest-CreateVolumesFromImageTest-1319999963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:23 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:42:23 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:23 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-6605d839-dc33-4b3b-a22f-68b40569af73 tempest-CreateVolumesFromImageTest-1319999963 None] Acquiring lock "cinder-3f3f55d6-e83a-4f08-b0a1-ffd7303c5ab7-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:23 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-6605d839-dc33-4b3b-a22f-68b40569af73 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "cinder-3f3f55d6-e83a-4f08-b0a1-ffd7303c5ab7-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:23 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-6605d839-dc33-4b3b-a22f-68b40569af73 tempest-CreateVolumesFromImageTest-1319999963 None] Acquiring lock "cinder-quobyte-3f3f55d6-e83a-4f08-b0a1-ffd7303c5ab7" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:23 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-6605d839-dc33-4b3b-a22f-68b40569af73 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "cinder-quobyte-3f3f55d6-e83a-4f08-b0a1-ffd7303c5ab7" acquired by "delete_volume" :: waited 0.023s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:23 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[2954f83c-cd31-45a2-adc2-01b10da4c3d1]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-6605d839-dc33-4b3b-a22f-68b40569af73 tempest-CreateVolumesFromImageTest-1319999963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3f3f55d6-e83a-4f08-b0a1-ffd7303c5ab7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:23 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3f3f55d6-e83a-4f08-b0a1-ffd7303c5ab7 Apr 29 06:42:23 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:23 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9b79e221-34ab-4a81-b5ca-f20c5a5f3865 tempest-VolumesGetTest-1294989752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca" returned: 0 in 0.986s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9b79e221-34ab-4a81-b5ca-f20c5a5f3865 tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:23 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca Apr 29 06:42:23 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:23 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5577d1c-295f-4fb0-80e2-526d4f878b94 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94.7da5db2b-5055-4dc3-99d3-acb28157182e" returned: 0 in 1.345s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:23 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94.7da5db2b-5055-4dc3-99d3-acb28157182e is being set with open permissions: ugo+rw: NotImplementedError Apr 29 06:42:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94.7da5db2b-5055-4dc3-99d3-acb28157182e {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:23 devstack sudo[90185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94.7da5db2b-5055-4dc3-99d3-acb28157182e Apr 29 06:42:23 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:24 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d2f7ffd6-8d28-458e-a10a-39c2d52b55e4 tempest-CreateVolumesFromImageTest-1319999963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.977s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:24 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-d2f7ffd6-8d28-458e-a10a-39c2d52b55e4 tempest-CreateVolumesFromImageTest-1319999963 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:42:24 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-d2f7ffd6-8d28-458e-a10a-39c2d52b55e4 tempest-CreateVolumesFromImageTest-1319999963 None] Deleted volume successfully. Apr 29 06:42:24 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-d2f7ffd6-8d28-458e-a10a-39c2d52b55e4 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "cinder-502465bb-c80d-4725-9e9f-559f1e1e2293-delete_volume" released by "delete_volume" :: held 3.291s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:24 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-6605d839-dc33-4b3b-a22f-68b40569af73 tempest-CreateVolumesFromImageTest-1319999963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3f3f55d6-e83a-4f08-b0a1-ffd7303c5ab7" returned: 0 in 1.091s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-6605d839-dc33-4b3b-a22f-68b40569af73 tempest-CreateVolumesFromImageTest-1319999963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3f3f55d6-e83a-4f08-b0a1-ffd7303c5ab7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:24 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9b79e221-34ab-4a81-b5ca-f20c5a5f3865 tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca" returned: 0 in 0.702s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:24 devstack sudo[90193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3f3f55d6-e83a-4f08-b0a1-ffd7303c5ab7 Apr 29 06:42:24 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:24 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9b79e221-34ab-4a81-b5ca-f20c5a5f3865 tempest-VolumesGetTest-1294989752 None] Lock "cinder-quobyte-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca" released by "delete_volume" :: held 1.792s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:24 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-9b79e221-34ab-4a81-b5ca-f20c5a5f3865 tempest-VolumesGetTest-1294989752 None] Created reservations ['8b804836-ddbe-4969-8188-3b37c364b154', 'a53d8bf5-f4e4-4832-9cbf-4a256341a4f4', 'fc80c052-d940-4dde-ab66-adffa7da98fc', '979a8d96-76f7-4bd1-80c9-d8cc45fc0e63'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:42:24 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94.7da5db2b-5055-4dc3-99d3-acb28157182e" returned: 0 in 0.749s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9b79e221-34ab-4a81-b5ca-f20c5a5f3865 tempest-VolumesGetTest-1294989752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9b79e221-34ab-4a81-b5ca-f20c5a5f3865 tempest-VolumesGetTest-1294989752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:24 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9b79e221-34ab-4a81-b5ca-f20c5a5f3865 tempest-VolumesGetTest-1294989752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:42:24 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9b79e221-34ab-4a81-b5ca-f20c5a5f3865 tempest-VolumesGetTest-1294989752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:42:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9b79e221-34ab-4a81-b5ca-f20c5a5f3865 tempest-VolumesGetTest-1294989752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9b79e221-34ab-4a81-b5ca-f20c5a5f3865 tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:24 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94.info Apr 29 06:42:24 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:24 devstack sudo[90198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:42:24 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:25 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-6605d839-dc33-4b3b-a22f-68b40569af73 tempest-CreateVolumesFromImageTest-1319999963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3f3f55d6-e83a-4f08-b0a1-ffd7303c5ab7" returned: 0 in 0.870s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:25 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-6605d839-dc33-4b3b-a22f-68b40569af73 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "cinder-quobyte-3f3f55d6-e83a-4f08-b0a1-ffd7303c5ab7" released by "delete_volume" :: held 2.017s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:25 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94.info" returned: 0 in 0.710s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:25 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 06:42:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:25 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94.info Apr 29 06:42:25 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:25 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-6605d839-dc33-4b3b-a22f-68b40569af73 tempest-CreateVolumesFromImageTest-1319999963 None] Created reservations ['a9a265c5-5a43-477d-8f55-8783bb582b86', '2ddd56fd-8397-449b-b5ee-0def48078e37', 'b38c4839-f0a1-479a-b1f0-96202996ee36', 'cf4f0176-b6ab-473b-b3b6-de613a445812'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:42:25 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9b79e221-34ab-4a81-b5ca-f20c5a5f3865 tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.816s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:25 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-9b79e221-34ab-4a81-b5ca-f20c5a5f3865 tempest-VolumesGetTest-1294989752 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:42:25 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-9b79e221-34ab-4a81-b5ca-f20c5a5f3865 tempest-VolumesGetTest-1294989752 None] Deleted volume successfully. Apr 29 06:42:25 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9b79e221-34ab-4a81-b5ca-f20c5a5f3865 tempest-VolumesGetTest-1294989752 None] Lock "cinder-9beeaa2c-c9f5-4439-8909-d6cb7f36b2ca-delete_volume" released by "delete_volume" :: held 2.948s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-6605d839-dc33-4b3b-a22f-68b40569af73 tempest-CreateVolumesFromImageTest-1319999963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-6605d839-dc33-4b3b-a22f-68b40569af73 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:25 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-6605d839-dc33-4b3b-a22f-68b40569af73 tempest-CreateVolumesFromImageTest-1319999963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:42:25 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-6605d839-dc33-4b3b-a22f-68b40569af73 tempest-CreateVolumesFromImageTest-1319999963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:42:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-6605d839-dc33-4b3b-a22f-68b40569af73 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-6605d839-dc33-4b3b-a22f-68b40569af73 tempest-CreateVolumesFromImageTest-1319999963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:25 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:42:25 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:26 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94.info" returned: 0 in 0.793s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.813s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] Creating offline snapshot ae12c291-5f0b-475d-9758-615c8c1938b2 of volume 20bc01db-c1ef-46f0-ae7d-36c8eafe9c86 {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[498a35d6-a9e5-4a31-8456-4ee1e7691385]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:26 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-6605d839-dc33-4b3b-a22f-68b40569af73 tempest-CreateVolumesFromImageTest-1319999963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.749s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-6605d839-dc33-4b3b-a22f-68b40569af73 tempest-CreateVolumesFromImageTest-1319999963 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:42:26 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-6605d839-dc33-4b3b-a22f-68b40569af73 tempest-CreateVolumesFromImageTest-1319999963 None] Deleted volume successfully. Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-6605d839-dc33-4b3b-a22f-68b40569af73 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "cinder-3f3f55d6-e83a-4f08-b0a1-ffd7303c5ab7-delete_volume" released by "delete_volume" :: held 3.164s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:26 devstack sudo[90209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86 Apr 29 06:42:26 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Flow 'volume_create_manager' (6af7f227-2e45-4b28-a68b-d8d8e56d8256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (256fcd0b-a39f-47d0-bdb5-b30b07747c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (256fcd0b-a39f-47d0-bdb5-b30b07747c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1668876121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e9d3d5-57f9-41cb-835d-5eb24f6bd045,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='de093ceebc784c93b0b02e0c89978247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:42:26Z,use_quota=True,user_id='46456f53c8ca414a88ce4258a59158ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a0a328-7209-4248-8c04-88cbadac632a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a0a328-7209-4248-8c04-88cbadac632a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc0ee57-62ba-4d25-9f91-c036bc07f2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG cinder.image.glance [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Creating Keystone auth plugin from conf {{(pid=84195) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-30865e70-04f8-4e02-b593-8ef967beef8d tempest-CreateVolumesFromImageTest-1319999963 None] Acquiring lock "cinder-91c357b4-ede9-433e-9a6c-1af335d18c18-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-30865e70-04f8-4e02-b593-8ef967beef8d tempest-CreateVolumesFromImageTest-1319999963 None] Lock "cinder-91c357b4-ede9-433e-9a6c-1af335d18c18-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-30865e70-04f8-4e02-b593-8ef967beef8d tempest-CreateVolumesFromImageTest-1319999963 None] Acquiring lock "cinder-quobyte-91c357b4-ede9-433e-9a6c-1af335d18c18" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-30865e70-04f8-4e02-b593-8ef967beef8d tempest-CreateVolumesFromImageTest-1319999963 None] Lock "cinder-quobyte-91c357b4-ede9-433e-9a6c-1af335d18c18" acquired by "delete_volume" :: waited 0.027s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b492dd-2da4-40d7-ab2b-b373b3d78721]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-30865e70-04f8-4e02-b593-8ef967beef8d tempest-CreateVolumesFromImageTest-1319999963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-91c357b4-ede9-433e-9a6c-1af335d18c18 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Flow 'volume_create_manager' (4b537ed5-1c0d-494f-acb4-297fa26b8f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b191082a-8f63-4652-990f-4366392595bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:26 devstack sudo[90212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-91c357b4-ede9-433e-9a6c-1af335d18c18 Apr 29 06:42:26 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b191082a-8f63-4652-990f-4366392595bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1266656557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6627eec-d988-4f51-90cb-26ebcc610473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc83b54e6e42413e9d12aa80e8c34164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:42:27Z,use_quota=True,user_id='b76f3d1ccaf141a9ac8b1a5b3b19dbed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8c305d-16dc-48f5-bb59-d09cec9dcd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8c305d-16dc-48f5-bb59-d09cec9dcd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49947034-5db3-48f5-bcb9-dcb0226a3be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49947034-5db3-48f5-bcb9-dcb0226a3be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6627eec-d988-4f51-90cb-26ebcc610473', 'volume_name': 'volume-b6627eec-d988-4f51-90cb-26ebcc610473', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb836d9-b4e7-4ed5-a709-2ac3189d0960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb836d9-b4e7-4ed5-a709-2ac3189d0960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a37b27e-384e-4a9e-a63f-3daf0c24b2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:27 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Volume b6627eec-d988-4f51-90cb-26ebcc610473: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6627eec-d988-4f51-90cb-26ebcc610473', 'volume_size': 1} Apr 29 06:42:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc0ee57-62ba-4d25-9f91-c036bc07f2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '20e9d3d5-57f9-41cb-835d-5eb24f6bd045', 'volume_name': 'volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045', 'volume_size': 1, 'image_id': '3c917343-78b7-403b-853d-4aeabac3edf1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c917343-78b7-403b-853d-4aeabac3edf1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0b2d77ae633e436aa18dac7e4fad942b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c917343-78b7-403b-853d-4aeabac3edf1', 'created_at': datetime.datetime(2026, 4, 29, 4, 32, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 4, 32, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c917343-78b7-403b-853d-4aeabac3edf1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e28eaf-dda7-43a2-9606-d18a25dc12b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e28eaf-dda7-43a2-9606-d18a25dc12b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb6eb9b-5bb8-4da6-bf4f-1d9296e64031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:27 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Volume 20e9d3d5-57f9-41cb-835d-5eb24f6bd045: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045', 'volume_size': 1, 'image_id': '3c917343-78b7-403b-853d-4aeabac3edf1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c917343-78b7-403b-853d-4aeabac3edf1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0b2d77ae633e436aa18dac7e4fad942b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c917343-78b7-403b-853d-4aeabac3edf1', 'created_at': datetime.datetime(2026, 4, 29, 4, 32, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 4, 32, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c917343-78b7-403b-853d-4aeabac3edf1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 06:42:27 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Trying to clone 20e9d3d5-57f9-41cb-835d-5eb24f6bd045 from image 3c917343-78b7-403b-853d-4aeabac3edf1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3c917343-78b7-403b-853d-4aeabac3edf1', 'metadata': {}}]). {{(pid=84195) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 29 06:42:27 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86" returned: 0 in 0.882s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86.ae12c291-5f0b-475d-9758-615c8c1938b2 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:27 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86.ae12c291-5f0b-475d-9758-615c8c1938b2 1G Apr 29 06:42:27 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:27 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_4p8t3qeydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84195) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 06:42:27 devstack cinder-volume[84195]: INFO cinder.image.image_utils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Image download 20.69 MB at 20.69 MB/s Apr 29 06:42:27 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb4ce5b-b1c1-476f-aaef-15900ba6ce3b]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_4p8t3qeydevstack@QuobyteHD {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:27 devstack sudo[90222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_4p8t3qeydevstack@QuobyteHD Apr 29 06:42:27 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:27 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-30865e70-04f8-4e02-b593-8ef967beef8d tempest-CreateVolumesFromImageTest-1319999963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-91c357b4-ede9-433e-9a6c-1af335d18c18" returned: 0 in 0.842s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-30865e70-04f8-4e02-b593-8ef967beef8d tempest-CreateVolumesFromImageTest-1319999963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-91c357b4-ede9-433e-9a6c-1af335d18c18 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:27 devstack sudo[90225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-91c357b4-ede9-433e-9a6c-1af335d18c18 Apr 29 06:42:27 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:28 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86.ae12c291-5f0b-475d-9758-615c8c1938b2 1G" returned: 0 in 0.885s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86.ae12c291-5f0b-475d-9758-615c8c1938b2 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:28 devstack sudo[90230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86.ae12c291-5f0b-475d-9758-615c8c1938b2 Apr 29 06:42:28 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:28 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_4p8t3qeydevstack@QuobyteHD" returned: 0 in 0.784s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:28 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Temporary image 3c917343-78b7-403b-853d-4aeabac3edf1 is fetched for user 46456f53c8ca414a88ce4258a59158ba. {{(pid=84195) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 06:42:28 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-30865e70-04f8-4e02-b593-8ef967beef8d tempest-CreateVolumesFromImageTest-1319999963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-91c357b4-ede9-433e-9a6c-1af335d18c18" returned: 0 in 0.696s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:28 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-30865e70-04f8-4e02-b593-8ef967beef8d tempest-CreateVolumesFromImageTest-1319999963 None] Lock "cinder-quobyte-91c357b4-ede9-433e-9a6c-1af335d18c18" released by "delete_volume" :: held 1.616s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:28 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[e290a5c4-03b5-4936-a099-b15a1146850d]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_4p8t3qeydevstack@QuobyteHD {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:28 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-30865e70-04f8-4e02-b593-8ef967beef8d tempest-CreateVolumesFromImageTest-1319999963 None] Created reservations ['23715365-2a59-4bc4-9e44-a0b52693ee21', 'a4338975-35f2-4a05-b298-9161d07a1f89', '6dd87db5-b825-4c7a-af88-c3097d109b6a', '631399a4-b7bc-4df7-8871-a23ad6d9def2'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:42:28 devstack sudo[90236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_4p8t3qeydevstack@QuobyteHD Apr 29 06:42:28 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-30865e70-04f8-4e02-b593-8ef967beef8d tempest-CreateVolumesFromImageTest-1319999963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-30865e70-04f8-4e02-b593-8ef967beef8d tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:28 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-30865e70-04f8-4e02-b593-8ef967beef8d tempest-CreateVolumesFromImageTest-1319999963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:42:28 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-30865e70-04f8-4e02-b593-8ef967beef8d tempest-CreateVolumesFromImageTest-1319999963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:42:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-30865e70-04f8-4e02-b593-8ef967beef8d tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-30865e70-04f8-4e02-b593-8ef967beef8d tempest-CreateVolumesFromImageTest-1319999963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:28 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:42:28 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:28 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86.ae12c291-5f0b-475d-9758-615c8c1938b2" returned: 0 in 0.677s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:28 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86.ae12c291-5f0b-475d-9758-615c8c1938b2 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 06:42:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86.ae12c291-5f0b-475d-9758-615c8c1938b2 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:28 devstack sudo[90243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86.ae12c291-5f0b-475d-9758-615c8c1938b2 Apr 29 06:42:28 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:29 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5a220b72-9f73-4e89-898d-b520b9272cb8 tempest-CreateVolumesFromImageTest-1319999963 None] Acquiring lock "cinder-98239649-03bc-47e8-9d1a-f9d15b635d61-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:29 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5a220b72-9f73-4e89-898d-b520b9272cb8 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "cinder-98239649-03bc-47e8-9d1a-f9d15b635d61-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:29 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5a220b72-9f73-4e89-898d-b520b9272cb8 tempest-CreateVolumesFromImageTest-1319999963 None] Acquiring lock "cinder-quobyte-98239649-03bc-47e8-9d1a-f9d15b635d61" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:29 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5a220b72-9f73-4e89-898d-b520b9272cb8 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "cinder-quobyte-98239649-03bc-47e8-9d1a-f9d15b635d61" acquired by "delete_volume" :: waited 0.022s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:29 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a05e0f8-7e15-43c4-acb0-41b465c1b8a5]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5a220b72-9f73-4e89-898d-b520b9272cb8 tempest-CreateVolumesFromImageTest-1319999963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-98239649-03bc-47e8-9d1a-f9d15b635d61 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:29 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_4p8t3qeydevstack@QuobyteHD" returned: 0 in 0.780s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:29 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-30865e70-04f8-4e02-b593-8ef967beef8d tempest-CreateVolumesFromImageTest-1319999963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.695s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:29 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-30865e70-04f8-4e02-b593-8ef967beef8d tempest-CreateVolumesFromImageTest-1319999963 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:42:29 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-30865e70-04f8-4e02-b593-8ef967beef8d tempest-CreateVolumesFromImageTest-1319999963 None] Deleted volume successfully. Apr 29 06:42:29 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-30865e70-04f8-4e02-b593-8ef967beef8d tempest-CreateVolumesFromImageTest-1319999963 None] Lock "cinder-91c357b4-ede9-433e-9a6c-1af335d18c18-delete_volume" released by "delete_volume" :: held 2.603s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:29 devstack sudo[90249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-98239649-03bc-47e8-9d1a-f9d15b635d61 Apr 29 06:42:29 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:29 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86.ae12c291-5f0b-475d-9758-615c8c1938b2" returned: 0 in 0.695s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:29 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86.info Apr 29 06:42:29 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:29 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5a220b72-9f73-4e89-898d-b520b9272cb8 tempest-CreateVolumesFromImageTest-1319999963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-98239649-03bc-47e8-9d1a-f9d15b635d61" returned: 0 in 0.748s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5a220b72-9f73-4e89-898d-b520b9272cb8 tempest-CreateVolumesFromImageTest-1319999963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-98239649-03bc-47e8-9d1a-f9d15b635d61 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:29 devstack sudo[90258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-98239649-03bc-47e8-9d1a-f9d15b635d61 Apr 29 06:42:29 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:30 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86.info" returned: 0 in 0.649s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:30 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 06:42:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:30 devstack sudo[90260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86.info Apr 29 06:42:30 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:30 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5a220b72-9f73-4e89-898d-b520b9272cb8 tempest-CreateVolumesFromImageTest-1319999963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-98239649-03bc-47e8-9d1a-f9d15b635d61" returned: 0 in 0.629s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:30 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5a220b72-9f73-4e89-898d-b520b9272cb8 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "cinder-quobyte-98239649-03bc-47e8-9d1a-f9d15b635d61" released by "delete_volume" :: held 1.437s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:30 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-5a220b72-9f73-4e89-898d-b520b9272cb8 tempest-CreateVolumesFromImageTest-1319999963 None] Created reservations ['65081366-125e-49f4-8c58-6e43ba4ba0f4', 'f6dce91c-6bdb-4287-a272-9a6b2309434d', '2bf8650b-6feb-490f-ab5e-ce192e9f4a77', '5470d34a-59d9-4ffc-ba42-63fb1830f6df'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:42:30 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86.info" returned: 0 in 0.612s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.502s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.682s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:30 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1266656557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6627eec-d988-4f51-90cb-26ebcc610473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc83b54e6e42413e9d12aa80e8c34164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:42:27Z,use_quota=True,user_id='b76f3d1ccaf141a9ac8b1a5b3b19dbed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:42:30 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Creating volume b6627eec-d988-4f51-90cb-26ebcc610473 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:42:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:30 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:42:30 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:42:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:30 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:42:30 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:42:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:30 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473 1073741824 Apr 29 06:42:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5a220b72-9f73-4e89-898d-b520b9272cb8 tempest-CreateVolumesFromImageTest-1319999963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:30 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5a220b72-9f73-4e89-898d-b520b9272cb8 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:30 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5a220b72-9f73-4e89-898d-b520b9272cb8 tempest-CreateVolumesFromImageTest-1319999963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:42:30 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5a220b72-9f73-4e89-898d-b520b9272cb8 tempest-CreateVolumesFromImageTest-1319999963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:42:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5a220b72-9f73-4e89-898d-b520b9272cb8 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5a220b72-9f73-4e89-898d-b520b9272cb8 tempest-CreateVolumesFromImageTest-1319999963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:30 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:42:30 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:30 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-dd7cf131-137c-49dc-af34-2be622640160 tempest-GroupSnapshotsTest-841847317 None] group_snapshot 2f7a612e-0bda-49b9-aa01-51feb3ad8d5f: created successfully Apr 29 06:42:31 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] group_snapshot 2f7a612e-0bda-49b9-aa01-51feb3ad8d5f: deleting Apr 29 06:42:31 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] group_snapshot 2f7a612e-0bda-49b9-aa01-51feb3ad8d5f: deleting {{(pid=84195) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 06:42:31 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "cinder-quobyte-a5577d1c-295f-4fb0-80e2-526d4f878b94" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:31 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-a5577d1c-295f-4fb0-80e2-526d4f878b94" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:31 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "cinder-quobyte-7da5db2b-5055-4dc3-99d3-acb28157182e" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:31 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-7da5db2b-5055-4dc3-99d3-acb28157182e" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:31 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] Deleting offline snapshot 7da5db2b-5055-4dc3-99d3-acb28157182e of volume a5577d1c-295f-4fb0-80e2-526d4f878b94 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:42:31 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] snapshot_file for this snap is: volume-a5577d1c-295f-4fb0-80e2-526d4f878b94.7da5db2b-5055-4dc3-99d3-acb28157182e {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:42:31 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:31 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4287a1c8-29d8-4029-8523-fb87818e5a51 tempest-CreateVolumesFromImageTest-1319999963 None] Acquiring lock "cinder-659f7b2b-87d1-45de-a61a-2208cdee18ab-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:31 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[920aa6c7-e20e-4f2a-b589-baa91e8d0ec5]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94.7da5db2b-5055-4dc3-99d3-acb28157182e {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5a220b72-9f73-4e89-898d-b520b9272cb8 tempest-CreateVolumesFromImageTest-1319999963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.676s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:31 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-5a220b72-9f73-4e89-898d-b520b9272cb8 tempest-CreateVolumesFromImageTest-1319999963 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:42:31 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-5a220b72-9f73-4e89-898d-b520b9272cb8 tempest-CreateVolumesFromImageTest-1319999963 None] Deleted volume successfully. Apr 29 06:42:31 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4287a1c8-29d8-4029-8523-fb87818e5a51 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "cinder-659f7b2b-87d1-45de-a61a-2208cdee18ab-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:31 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5a220b72-9f73-4e89-898d-b520b9272cb8 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "cinder-98239649-03bc-47e8-9d1a-f9d15b635d61-delete_volume" released by "delete_volume" :: held 2.411s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:31 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4287a1c8-29d8-4029-8523-fb87818e5a51 tempest-CreateVolumesFromImageTest-1319999963 None] Acquiring lock "cinder-quobyte-659f7b2b-87d1-45de-a61a-2208cdee18ab" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:31 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4287a1c8-29d8-4029-8523-fb87818e5a51 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "cinder-quobyte-659f7b2b-87d1-45de-a61a-2208cdee18ab" acquired by "delete_volume" :: waited 0.017s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:31 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a806d0a-67a3-4623-89f9-70cabc9fa390]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4287a1c8-29d8-4029-8523-fb87818e5a51 tempest-CreateVolumesFromImageTest-1319999963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-659f7b2b-87d1-45de-a61a-2208cdee18ab {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:31 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94.7da5db2b-5055-4dc3-99d3-acb28157182e Apr 29 06:42:31 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:31 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-659f7b2b-87d1-45de-a61a-2208cdee18ab Apr 29 06:42:31 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:31 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473 1073741824" returned: 0 in 0.966s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:31 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473 Apr 29 06:42:31 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:32 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94.7da5db2b-5055-4dc3-99d3-acb28157182e" returned: 0 in 0.886s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:32 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5577d1c-295f-4fb0-80e2-526d4f878b94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:42:32 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc33c003-5cc3-4152-885f-1a3453d52b65]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:32 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473" returned: 0 in 0.628s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:32 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:42:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.164s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:32 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:32 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1668876121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e9d3d5-57f9-41cb-835d-5eb24f6bd045,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='de093ceebc784c93b0b02e0c89978247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:42:26Z,use_quota=True,user_id='46456f53c8ca414a88ce4258a59158ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:42:32 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Creating volume 20e9d3d5-57f9-41cb-835d-5eb24f6bd045 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:42:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:32 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:42:32 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:42:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:32 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:42:32 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:42:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4287a1c8-29d8-4029-8523-fb87818e5a51 tempest-CreateVolumesFromImageTest-1319999963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-659f7b2b-87d1-45de-a61a-2208cdee18ab" returned: 0 in 0.835s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4287a1c8-29d8-4029-8523-fb87818e5a51 tempest-CreateVolumesFromImageTest-1319999963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-659f7b2b-87d1-45de-a61a-2208cdee18ab {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:32 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045 1073741824 Apr 29 06:42:32 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:32 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a37b27e-384e-4a9e-a63f-3daf0c24b2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6627eec-d988-4f51-90cb-26ebcc610473', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:32 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7ed7cad-1269-4a0c-b267-f2e6a5959015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:32 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-659f7b2b-87d1-45de-a61a-2208cdee18ab Apr 29 06:42:32 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:32 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Volume volume-b6627eec-d988-4f51-90cb-26ebcc610473 (b6627eec-d988-4f51-90cb-26ebcc610473): created successfully Apr 29 06:42:32 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7ed7cad-1269-4a0c-b267-f2e6a5959015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:32 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Flow 'volume_create_manager' (4b537ed5-1c0d-494f-acb4-297fa26b8f88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:42:32 devstack sudo[90293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94 Apr 29 06:42:32 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:32 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-5181af60-0a27-47c3-8862-178565f37d36 tempest-SnapshotsActionsTest-302093101 None] Created volume successfully. Apr 29 06:42:33 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4287a1c8-29d8-4029-8523-fb87818e5a51 tempest-CreateVolumesFromImageTest-1319999963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-659f7b2b-87d1-45de-a61a-2208cdee18ab" returned: 0 in 0.735s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:33 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4287a1c8-29d8-4029-8523-fb87818e5a51 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "cinder-quobyte-659f7b2b-87d1-45de-a61a-2208cdee18ab" released by "delete_volume" :: held 1.614s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:33 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94" returned: 0 in 0.852s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94.7da5db2b-5055-4dc3-99d3-acb28157182e {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:33 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-4287a1c8-29d8-4029-8523-fb87818e5a51 tempest-CreateVolumesFromImageTest-1319999963 None] Created reservations ['1d6a531f-98e1-4db4-92f4-ee1584dde301', '1c03fdb4-ee0b-4af9-9bf4-cf7685e9a82f', 'a3c6dc46-de0d-40dc-ad7f-6ef1bd06f874', '0ece9449-d070-49e5-bffb-64458c226682'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:42:33 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94.7da5db2b-5055-4dc3-99d3-acb28157182e Apr 29 06:42:33 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4287a1c8-29d8-4029-8523-fb87818e5a51 tempest-CreateVolumesFromImageTest-1319999963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4287a1c8-29d8-4029-8523-fb87818e5a51 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:33 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4287a1c8-29d8-4029-8523-fb87818e5a51 tempest-CreateVolumesFromImageTest-1319999963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:42:33 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4287a1c8-29d8-4029-8523-fb87818e5a51 tempest-CreateVolumesFromImageTest-1319999963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:42:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4287a1c8-29d8-4029-8523-fb87818e5a51 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4287a1c8-29d8-4029-8523-fb87818e5a51 tempest-CreateVolumesFromImageTest-1319999963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:33 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:42:33 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:33 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045 1073741824" returned: 0 in 1.001s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:33 devstack sudo[90311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045 Apr 29 06:42:33 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-385958e1-efbb-4f01-a2e0-455ea11c1b4b tempest-SnapshotsActionsTest-302093101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:34 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4287a1c8-29d8-4029-8523-fb87818e5a51 tempest-CreateVolumesFromImageTest-1319999963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.782s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:34 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-4287a1c8-29d8-4029-8523-fb87818e5a51 tempest-CreateVolumesFromImageTest-1319999963 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:42:34 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-4287a1c8-29d8-4029-8523-fb87818e5a51 tempest-CreateVolumesFromImageTest-1319999963 None] Deleted volume successfully. Apr 29 06:42:34 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4287a1c8-29d8-4029-8523-fb87818e5a51 tempest-CreateVolumesFromImageTest-1319999963 None] Lock "cinder-659f7b2b-87d1-45de-a61a-2208cdee18ab-delete_volume" released by "delete_volume" :: held 2.649s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:34 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94.7da5db2b-5055-4dc3-99d3-acb28157182e" returned: 0 in 0.956s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94.7da5db2b-5055-4dc3-99d3-acb28157182e {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:34 devstack sudo[90319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94.7da5db2b-5055-4dc3-99d3-acb28157182e Apr 29 06:42:34 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:34 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045" returned: 0 in 0.807s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] <== create_volume: return (1864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:42:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-385958e1-efbb-4f01-a2e0-455ea11c1b4b tempest-SnapshotsActionsTest-302093101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.571s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-385958e1-efbb-4f01-a2e0-455ea11c1b4b tempest-SnapshotsActionsTest-302093101 None] Creating offline snapshot cbe39def-5a1c-4ab5-ab64-ab85abc80896 of volume b6627eec-d988-4f51-90cb-26ebcc610473 {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:42:34 devstack cinder-volume[84195]: DEBUG cinder.volume.volume_utils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Attempting download of 3c917343-78b7-403b-853d-4aeabac3edf1 ((None, [{'url': 'file:///opt/stack/data/glance/images/3c917343-78b7-403b-853d-4aeabac3edf1', 'metadata': {}}])) to volume 20e9d3d5-57f9-41cb-835d-5eb24f6bd045. {{(pid=84195) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 06:42:34 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dba7f5-3d62-4140-bcb1-5a3f4fb9a48f]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-385958e1-efbb-4f01-a2e0-455ea11c1b4b tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:34 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[370e80f7-4936-4d3b-acf9-30b924c7bd9a]: (4, 'raw') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c917343-78b7-403b-853d-4aeabac3edf1_pj43k7k4 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:34 devstack sudo[90321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473 Apr 29 06:42:34 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:34 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c917343-78b7-403b-853d-4aeabac3edf1_pj43k7k4 Apr 29 06:42:34 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:34 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94.7da5db2b-5055-4dc3-99d3-acb28157182e" returned: 0 in 0.808s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:35 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-7da5db2b-5055-4dc3-99d3-acb28157182e" released by "_delete_snapshot" :: held 3.661s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:35 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-a5577d1c-295f-4fb0-80e2-526d4f878b94" released by "delete_snapshot" :: held 3.706s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:35 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "cinder-quobyte-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:35 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:35 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "cinder-quobyte-ae12c291-5f0b-475d-9758-615c8c1938b2" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:35 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-ae12c291-5f0b-475d-9758-615c8c1938b2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] Deleting offline snapshot ae12c291-5f0b-475d-9758-615c8c1938b2 of volume 20bc01db-c1ef-46f0-ae7d-36c8eafe9c86 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:42:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] snapshot_file for this snap is: volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86.ae12c291-5f0b-475d-9758-615c8c1938b2 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:42:35 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70b89cf-15c9-4623-84a1-0f235aa7429e]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86.ae12c291-5f0b-475d-9758-615c8c1938b2 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:35 devstack sudo[90328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86.ae12c291-5f0b-475d-9758-615c8c1938b2 Apr 29 06:42:35 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:35 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c917343-78b7-403b-853d-4aeabac3edf1_pj43k7k4" returned: 0 in 0.909s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c917343-78b7-403b-853d-4aeabac3edf1_pj43k7k4 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:35 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-385958e1-efbb-4f01-a2e0-455ea11c1b4b tempest-SnapshotsActionsTest-302093101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473" returned: 0 in 1.103s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-385958e1-efbb-4f01-a2e0-455ea11c1b4b tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:35 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c917343-78b7-403b-853d-4aeabac3edf1_pj43k7k4 Apr 29 06:42:35 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:35 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 1G Apr 29 06:42:35 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:35 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86.ae12c291-5f0b-475d-9758-615c8c1938b2" returned: 0 in 0.847s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:42:35 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a5f28f-7189-4aaf-b6ed-c527e6a8d7cc]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:36 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:36 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86 Apr 29 06:42:36 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c917343-78b7-403b-853d-4aeabac3edf1_pj43k7k4" returned: 1 in 0.843s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c917343-78b7-403b-853d-4aeabac3edf1_pj43k7k4' failed. Not Retrying. {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 06:42:36 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ff99d6-09f9-4ad5-9084-3871efd0dca8]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_4p8t3qeydevstack@QuobyteHD {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:36 devstack sudo[90351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_4p8t3qeydevstack@QuobyteHD Apr 29 06:42:36 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:36 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-385958e1-efbb-4f01-a2e0-455ea11c1b4b tempest-SnapshotsActionsTest-302093101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 1G" returned: 0 in 0.920s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-385958e1-efbb-4f01-a2e0-455ea11c1b4b tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6627eec-d988-4f51-90cb-26ebcc610473 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:36 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6627eec-d988-4f51-90cb-26ebcc610473 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 Apr 29 06:42:36 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:36 devstack cinder-volume[84195]: DEBUG oslo_service.periodic_task [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84195) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 06:42:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:42:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:42:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:36 devstack sudo[90356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:42:36 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:36 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86" returned: 0 in 0.832s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86.ae12c291-5f0b-475d-9758-615c8c1938b2 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:36 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86.ae12c291-5f0b-475d-9758-615c8c1938b2 Apr 29 06:42:36 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:36 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_4p8t3qeydevstack@QuobyteHD" returned: 0 in 0.824s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:36 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] 3c917343-78b7-403b-853d-4aeabac3edf1 was qcow2, converting to raw {{(pid=84195) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 06:42:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_4p8t3qeydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:36 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_4p8t3qeydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045 Apr 29 06:42:36 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:37 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-385958e1-efbb-4f01-a2e0-455ea11c1b4b tempest-SnapshotsActionsTest-302093101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6627eec-d988-4f51-90cb-26ebcc610473 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896" returned: 0 in 0.694s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:37 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-385958e1-efbb-4f01-a2e0-455ea11c1b4b tempest-SnapshotsActionsTest-302093101 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 is being set with open permissions: ugo+rw Apr 29 06:42:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-385958e1-efbb-4f01-a2e0-455ea11c1b4b tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:37 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 Apr 29 06:42:37 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:37 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.672s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:37 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:42:37 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86.ae12c291-5f0b-475d-9758-615c8c1938b2" returned: 0 in 0.724s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86.ae12c291-5f0b-475d-9758-615c8c1938b2 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:37 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86.ae12c291-5f0b-475d-9758-615c8c1938b2 Apr 29 06:42:37 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:37 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-385958e1-efbb-4f01-a2e0-455ea11c1b4b tempest-SnapshotsActionsTest-302093101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896" returned: 0 in 0.712s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-385958e1-efbb-4f01-a2e0-455ea11c1b4b tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:37 devstack sudo[90397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.info Apr 29 06:42:37 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:38 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86.ae12c291-5f0b-475d-9758-615c8c1938b2" returned: 0 in 0.686s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:38 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-ae12c291-5f0b-475d-9758-615c8c1938b2" released by "_delete_snapshot" :: held 3.206s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:38 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86" released by "delete_snapshot" :: held 3.231s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:38 devstack cinder-volume[84195]: WARNING cinder.quota [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-594467942 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-594467942, it is now deprecated. Please use the default quota class for default quota. Apr 29 06:42:38 devstack cinder-volume[84195]: WARNING cinder.quota [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-594467942 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-594467942, it is now deprecated. Please use the default quota class for default quota. Apr 29 06:42:38 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] Created reservations ['a92838db-aa6e-4ed5-bfd2-2b57ad552a5f', '4d9a0e75-eeb5-4fdf-8746-5ff13cc5b5f5', '6590600f-f1c0-44ea-bcf0-2790380ad34b', '770e0a94-9ce0-403e-ac85-52149b4c0414'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:42:38 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] Created reservations ['675e4d30-581a-425f-96ff-c0e8828565da', '786daa81-893d-4165-9e93-0effb2cecaaf', '8b6ed3b6-bef5-4fd8-85d8-ed2283cff4b1', 'cfd09097-3fa8-4333-b3aa-e699e73bfd19'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:42:38 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-7cdf2a55-4224-48cc-8ab9-861e1f1afe9e tempest-GroupSnapshotsTest-841847317 None] group_snapshot 2f7a612e-0bda-49b9-aa01-51feb3ad8d5f: deleted successfully Apr 29 06:42:38 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-385958e1-efbb-4f01-a2e0-455ea11c1b4b tempest-SnapshotsActionsTest-302093101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.info" returned: 0 in 0.824s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:38 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-385958e1-efbb-4f01-a2e0-455ea11c1b4b tempest-SnapshotsActionsTest-302093101 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.info is being set with open permissions: ugo+rw Apr 29 06:42:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-385958e1-efbb-4f01-a2e0-455ea11c1b4b tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:38 devstack sudo[90401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.info Apr 29 06:42:38 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:39 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_4p8t3qeydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045" returned: 0 in 2.117s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:39 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_4p8t3qeydevstack@QuobyteHD, size 112.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045 {{(pid=84195) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 06:42:39 devstack cinder-volume[84195]: INFO cinder.image.image_utils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Converted 112.00 MB image at 52.87 MB/s Apr 29 06:42:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:39 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045 1G Apr 29 06:42:39 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:39 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-919a8966-3112-4908-8681-97c3767abc09 tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "cinder-quobyte-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:39 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-919a8966-3112-4908-8681-97c3767abc09 tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86" acquired by "delete_volume" :: waited 0.026s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:39 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ee5289-daa7-4987-96ac-b12cd2c4ae6c]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-919a8966-3112-4908-8681-97c3767abc09 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:39 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-385958e1-efbb-4f01-a2e0-455ea11c1b4b tempest-SnapshotsActionsTest-302093101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.info" returned: 0 in 0.661s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-385958e1-efbb-4f01-a2e0-455ea11c1b4b tempest-SnapshotsActionsTest-302093101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.039s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:39 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-385958e1-efbb-4f01-a2e0-455ea11c1b4b tempest-SnapshotsActionsTest-302093101 None] Create snapshot completed successfully Apr 29 06:42:39 devstack sudo[90406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86 Apr 29 06:42:39 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:39 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045 1G" returned: 0 in 0.707s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:39 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee9531c-7ef9-4bb1-8460-7337e8426a60]: (4, 'raw') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:39 devstack sudo[90411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045 Apr 29 06:42:39 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:40 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-919a8966-3112-4908-8681-97c3767abc09 tempest-GroupSnapshotsTest-841847317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86" returned: 0 in 0.786s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-919a8966-3112-4908-8681-97c3767abc09 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:40 devstack sudo[90416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86 Apr 29 06:42:40 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:40 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045" returned: 0 in 0.860s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:40 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-919a8966-3112-4908-8681-97c3767abc09 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86" returned: 0 in 0.675s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-afa02d45-f927-4924-85d1-903c1df2d6c6 tempest-SnapshotsActionsTest-302093101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-afa02d45-f927-4924-85d1-903c1df2d6c6 tempest-SnapshotsActionsTest-302093101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:40 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-919a8966-3112-4908-8681-97c3767abc09 tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-20bc01db-c1ef-46f0-ae7d-36c8eafe9c86" released by "delete_volume" :: held 1.534s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:40 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-919a8966-3112-4908-8681-97c3767abc09 tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "cinder-quobyte-a5577d1c-295f-4fb0-80e2-526d4f878b94" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:40 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045 Apr 29 06:42:40 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:40 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-afa02d45-f927-4924-85d1-903c1df2d6c6 tempest-SnapshotsActionsTest-302093101 None] Creating offline snapshot 6e944dc1-9e54-450d-8574-9a23f796077d of volume b6627eec-d988-4f51-90cb-26ebcc610473 {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:42:40 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-919a8966-3112-4908-8681-97c3767abc09 tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-a5577d1c-295f-4fb0-80e2-526d4f878b94" acquired by "delete_volume" :: waited 0.112s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:40 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc08f37-7e43-4f7c-a7d8-a0d7169b83b5]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-afa02d45-f927-4924-85d1-903c1df2d6c6 tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:40 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a090097-d03e-4802-b384-73a79a920173]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-919a8966-3112-4908-8681-97c3767abc09 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:41 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 Apr 29 06:42:41 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:41 devstack sudo[90424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94 Apr 29 06:42:41 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:41 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045" returned: 1 in 0.773s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045' failed. Not Retrying. {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 06:42:41 devstack cinder-volume[84195]: DEBUG cinder.volume.volume_utils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Downloaded image 3c917343-78b7-403b-853d-4aeabac3edf1 ((None, [{'url': 'file:///opt/stack/data/glance/images/3c917343-78b7-403b-853d-4aeabac3edf1', 'metadata': {}}])) to volume 20e9d3d5-57f9-41cb-835d-5eb24f6bd045 successfully. {{(pid=84195) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 06:42:41 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Temporary image 3c917343-78b7-403b-853d-4aeabac3edf1 for user 46456f53c8ca414a88ce4258a59158ba is deleted. {{(pid=84195) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 06:42:41 devstack cinder-volume[84195]: DEBUG cinder.volume.volume_utils [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Marking volume 20e9d3d5-57f9-41cb-835d-5eb24f6bd045 as bootable. {{(pid=84195) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 06:42:41 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Copying metadata from image 3c917343-78b7-403b-853d-4aeabac3edf1 to 20e9d3d5-57f9-41cb-835d-5eb24f6bd045. {{(pid=84195) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 06:42:41 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Creating volume glance metadata for volume 20e9d3d5-57f9-41cb-835d-5eb24f6bd045 backed by image 3c917343-78b7-403b-853d-4aeabac3edf1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3c917343-78b7-403b-853d-4aeabac3edf1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84195) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 06:42:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb6eb9b-5bb8-4da6-bf4f-1d9296e64031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045', 'volume_size': 1, 'image_id': '3c917343-78b7-403b-853d-4aeabac3edf1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c917343-78b7-403b-853d-4aeabac3edf1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0b2d77ae633e436aa18dac7e4fad942b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c917343-78b7-403b-853d-4aeabac3edf1', 'created_at': datetime.datetime(2026, 4, 29, 4, 32, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 4, 32, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c917343-78b7-403b-853d-4aeabac3edf1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba0f5b3c-9fca-4055-b686-fc5d8383ca49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:41 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Volume volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045 (20e9d3d5-57f9-41cb-835d-5eb24f6bd045): created successfully Apr 29 06:42:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba0f5b3c-9fca-4055-b686-fc5d8383ca49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:41 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Flow 'volume_create_manager' (6af7f227-2e45-4b28-a68b-d8d8e56d8256) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:42:41 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-75c4244c-17d2-455d-b08c-7cac530e434b tempest-VolumesGetTest-1294989752 None] Created volume successfully. Apr 29 06:42:41 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-afa02d45-f927-4924-85d1-903c1df2d6c6 tempest-SnapshotsActionsTest-302093101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896" returned: 0 in 0.827s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:41 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-afa02d45-f927-4924-85d1-903c1df2d6c6 tempest-SnapshotsActionsTest-302093101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6627eec-d988-4f51-90cb-26ebcc610473(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:42:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-afa02d45-f927-4924-85d1-903c1df2d6c6 tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.6e944dc1-9e54-450d-8574-9a23f796077d 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:41 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.6e944dc1-9e54-450d-8574-9a23f796077d 1G Apr 29 06:42:41 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:41 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-919a8966-3112-4908-8681-97c3767abc09 tempest-GroupSnapshotsTest-841847317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94" returned: 0 in 0.872s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-919a8966-3112-4908-8681-97c3767abc09 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:41 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94 Apr 29 06:42:41 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:42 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-919a8966-3112-4908-8681-97c3767abc09 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a5577d1c-295f-4fb0-80e2-526d4f878b94" returned: 0 in 0.621s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:42 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-919a8966-3112-4908-8681-97c3767abc09 tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-a5577d1c-295f-4fb0-80e2-526d4f878b94" released by "delete_volume" :: held 1.566s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:42 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-919a8966-3112-4908-8681-97c3767abc09 tempest-GroupSnapshotsTest-841847317 None] Created reservations ['b90a0acc-bc4c-40e7-8ddd-5dcf9c4efbe4'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:42:42 devstack cinder-volume[84195]: WARNING cinder.quota [None req-919a8966-3112-4908-8681-97c3767abc09 tempest-GroupSnapshotsTest-841847317 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-594467942 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-594467942, it is now deprecated. Please use the default quota class for default quota. Apr 29 06:42:42 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-919a8966-3112-4908-8681-97c3767abc09 tempest-GroupSnapshotsTest-841847317 None] Created reservations ['76edf24a-f56d-4729-99f4-8b71e9a0d0ad', '45495dc0-fd5b-42a4-934f-31a8abff1bc2', '6006dc4d-c74b-4943-a5d8-f43dc6d07635', 'a860f271-11ec-442c-a023-c8ed599cf557'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:42:42 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-afa02d45-f927-4924-85d1-903c1df2d6c6 tempest-SnapshotsActionsTest-302093101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.6e944dc1-9e54-450d-8574-9a23f796077d 1G" returned: 0 in 0.901s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-afa02d45-f927-4924-85d1-903c1df2d6c6 tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.6e944dc1-9e54-450d-8574-9a23f796077d {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:42 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.6e944dc1-9e54-450d-8574-9a23f796077d Apr 29 06:42:42 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:42 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-919a8966-3112-4908-8681-97c3767abc09 tempest-GroupSnapshotsTest-841847317 None] Created reservations ['41a3c2aa-cada-4230-b20a-06939ba51e72', '8aaf883a-075f-4e09-93c9-6a9bf76909b6', '3739f409-edc4-4206-b77f-f94d96eee7fb', '8c2493fb-7771-4e20-82d2-a401399f77af'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:42:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-919a8966-3112-4908-8681-97c3767abc09 tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-919a8966-3112-4908-8681-97c3767abc09 tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:42 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-919a8966-3112-4908-8681-97c3767abc09 tempest-GroupSnapshotsTest-841847317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:42:42 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-919a8966-3112-4908-8681-97c3767abc09 tempest-GroupSnapshotsTest-841847317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:42:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-919a8966-3112-4908-8681-97c3767abc09 tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-919a8966-3112-4908-8681-97c3767abc09 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:42 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:42:42 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:43 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:42:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Flow 'volume_create_manager' (afd58925-c957-40a1-b179-d90ba34fed5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:42:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e69fadf-5287-462d-98c4-adb7688ad4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:43 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-afa02d45-f927-4924-85d1-903c1df2d6c6 tempest-SnapshotsActionsTest-302093101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.6e944dc1-9e54-450d-8574-9a23f796077d" returned: 0 in 0.755s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:43 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-afa02d45-f927-4924-85d1-903c1df2d6c6 tempest-SnapshotsActionsTest-302093101 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.6e944dc1-9e54-450d-8574-9a23f796077d is being set with open permissions: ugo+rw Apr 29 06:42:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-afa02d45-f927-4924-85d1-903c1df2d6c6 tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.6e944dc1-9e54-450d-8574-9a23f796077d {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:43 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.6e944dc1-9e54-450d-8574-9a23f796077d Apr 29 06:42:43 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e69fadf-5287-462d-98c4-adb7688ad4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:42:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1422645718',display_name='tempest-VolumesGetTest-Volume-423651213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96b43fe-e564-4d88-8030-044aee87b363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de093ceebc784c93b0b02e0c89978247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:42:43Z,use_quota=True,user_id='46456f53c8ca414a88ce4258a59158ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9f0f8ba-2680-4691-9000-eb328f79210b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9f0f8ba-2680-4691-9000-eb328f79210b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af07e612-35b8-4976-a557-aacb05305395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af07e612-35b8-4976-a557-aacb05305395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b96b43fe-e564-4d88-8030-044aee87b363', 'volume_name': 'volume-b96b43fe-e564-4d88-8030-044aee87b363', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c66541-64b6-4c19-8b15-4030fd372d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c66541-64b6-4c19-8b15-4030fd372d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37d860a0-9dcc-4d69-a39b-74feaf8145b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:43 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Volume b96b43fe-e564-4d88-8030-044aee87b363: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b96b43fe-e564-4d88-8030-044aee87b363', 'volume_size': 1} Apr 29 06:42:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:43 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-919a8966-3112-4908-8681-97c3767abc09 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.656s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:43 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-919a8966-3112-4908-8681-97c3767abc09 tempest-GroupSnapshotsTest-841847317 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:42:43 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-919a8966-3112-4908-8681-97c3767abc09 tempest-GroupSnapshotsTest-841847317 None] Delete group completed successfully. Apr 29 06:42:44 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-afa02d45-f927-4924-85d1-903c1df2d6c6 tempest-SnapshotsActionsTest-302093101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.6e944dc1-9e54-450d-8574-9a23f796077d" returned: 0 in 0.646s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-afa02d45-f927-4924-85d1-903c1df2d6c6 tempest-SnapshotsActionsTest-302093101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.328s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.616s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:42:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1422645718',display_name='tempest-VolumesGetTest-Volume-423651213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96b43fe-e564-4d88-8030-044aee87b363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de093ceebc784c93b0b02e0c89978247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:42:43Z,use_quota=True,user_id='46456f53c8ca414a88ce4258a59158ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:42:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Creating volume b96b43fe-e564-4d88-8030-044aee87b363 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:42:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:42:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:42:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:42:44 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:42:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b96b43fe-e564-4d88-8030-044aee87b363 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:44 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b96b43fe-e564-4d88-8030-044aee87b363 1073741824 Apr 29 06:42:44 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:44 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-16b25078-4cc1-4e24-b679-44f69c4ae686 tempest-GroupSnapshotsTest-841847317 None] Group tempest-GroupSnapshotsTest-Group-1278634655: creating Apr 29 06:42:44 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-afa02d45-f927-4924-85d1-903c1df2d6c6 tempest-SnapshotsActionsTest-302093101 None] Create snapshot completed successfully Apr 29 06:42:44 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-16b25078-4cc1-4e24-b679-44f69c4ae686 tempest-GroupSnapshotsTest-841847317 None] Group tempest-GroupSnapshotsTest-Group-1278634655: created successfully Apr 29 06:42:44 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-16b25078-4cc1-4e24-b679-44f69c4ae686 tempest-GroupSnapshotsTest-841847317 None] Create group completed successfully. Apr 29 06:42:44 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b96b43fe-e564-4d88-8030-044aee87b363 1073741824" returned: 0 in 0.795s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b96b43fe-e564-4d88-8030-044aee87b363 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:44 devstack sudo[90462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b96b43fe-e564-4d88-8030-044aee87b363 Apr 29 06:42:44 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:44 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1de24e87-c056-4306-9e80-a0374569070a tempest-SnapshotsActionsTest-953700288 None] Acquiring lock "cinder-6e944dc1-9e54-450d-8574-9a23f796077d-delete_snapshot" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1de24e87-c056-4306-9e80-a0374569070a tempest-SnapshotsActionsTest-953700288 None] Lock "cinder-6e944dc1-9e54-450d-8574-9a23f796077d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1de24e87-c056-4306-9e80-a0374569070a tempest-SnapshotsActionsTest-953700288 None] Acquiring lock "cinder-quobyte-b6627eec-d988-4f51-90cb-26ebcc610473" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1de24e87-c056-4306-9e80-a0374569070a tempest-SnapshotsActionsTest-953700288 None] Lock "cinder-quobyte-b6627eec-d988-4f51-90cb-26ebcc610473" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1de24e87-c056-4306-9e80-a0374569070a tempest-SnapshotsActionsTest-953700288 None] Acquiring lock "cinder-quobyte-6e944dc1-9e54-450d-8574-9a23f796077d" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1de24e87-c056-4306-9e80-a0374569070a tempest-SnapshotsActionsTest-953700288 None] Lock "cinder-quobyte-6e944dc1-9e54-450d-8574-9a23f796077d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-1de24e87-c056-4306-9e80-a0374569070a tempest-SnapshotsActionsTest-953700288 None] Deleting offline snapshot 6e944dc1-9e54-450d-8574-9a23f796077d of volume b6627eec-d988-4f51-90cb-26ebcc610473 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-1de24e87-c056-4306-9e80-a0374569070a tempest-SnapshotsActionsTest-953700288 None] snapshot_file for this snap is: volume-b6627eec-d988-4f51-90cb-26ebcc610473.6e944dc1-9e54-450d-8574-9a23f796077d {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[b889c29a-600c-4444-bfa5-ba51f7e17f87]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1de24e87-c056-4306-9e80-a0374569070a tempest-SnapshotsActionsTest-953700288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.6e944dc1-9e54-450d-8574-9a23f796077d {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:45 devstack sudo[90464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.6e944dc1-9e54-450d-8574-9a23f796077d Apr 29 06:42:45 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:45 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b96b43fe-e564-4d88-8030-044aee87b363" returned: 0 in 0.736s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Flow 'volume_create_manager' (0f95d19c-d870-4119-a631-b7db459bddd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de592a10-250d-4955-8ff2-e08f299ace96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37d860a0-9dcc-4d69-a39b-74feaf8145b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b96b43fe-e564-4d88-8030-044aee87b363', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb645404-041b-4c64-9344-39750239ba72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de592a10-250d-4955-8ff2-e08f299ace96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2001091664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b0468a58-90ee-4cd1-9e8a-f87c6b8195b3,host='devstack@QuobyteHD#QuobyteHD',id=b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d9e7b170394e1093075e88f3deb2fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:42:46Z,use_quota=True,user_id='5ebe735b9fb04d90a78dc3c973080675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57568dca-7ddf-4867-b0d4-8720dda7bc3d),volume_type_id=57568dca-7ddf-4867-b0d4-8720dda7bc3d)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b57f2cc-593e-4355-9972-274a6dcde65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b57f2cc-593e-4355-9972-274a6dcde65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4413537-d896-4fee-a355-65baf803e661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4413537-d896-4fee-a355-65baf803e661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8', 'volume_name': 'volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e500688d-b431-46dd-90e8-f58a896e3a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e500688d-b431-46dd-90e8-f58a896e3a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4b12d9-e44d-4152-9fb3-d0d3e4379f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:45 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Volume b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8', 'volume_size': 1} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b0468a58-90ee-4cd1-9e8a-f87c6b8195b3,created_at=2026-04-29T04:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2001091664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b0468a58-90ee-4cd1-9e8a-f87c6b8195b3,host='devstack@QuobyteHD#QuobyteHD',id=b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d9e7b170394e1093075e88f3deb2fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:42:46Z,use_quota=True,user_id='5ebe735b9fb04d90a78dc3c973080675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57568dca-7ddf-4867-b0d4-8720dda7bc3d),volume_type_id=57568dca-7ddf-4867-b0d4-8720dda7bc3d)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Creating volume b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:42:45 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:45 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Volume volume-b96b43fe-e564-4d88-8030-044aee87b363 (b96b43fe-e564-4d88-8030-044aee87b363): created successfully Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb645404-041b-4c64-9344-39750239ba72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Flow 'volume_create_manager' (afd58925-c957-40a1-b179-d90ba34fed5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:42:45 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8 1073741824 Apr 29 06:42:45 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:45 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-74f8759f-9d68-4e39-a3cd-197a14925140 tempest-VolumesGetTest-1294989752 None] Created volume successfully. Apr 29 06:42:45 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1de24e87-c056-4306-9e80-a0374569070a tempest-SnapshotsActionsTest-953700288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.6e944dc1-9e54-450d-8574-9a23f796077d" returned: 0 in 0.790s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-1de24e87-c056-4306-9e80-a0374569070a tempest-SnapshotsActionsTest-953700288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6627eec-d988-4f51-90cb-26ebcc610473(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2deff5-2d89-4205-962a-a8319b21edcc]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1de24e87-c056-4306-9e80-a0374569070a tempest-SnapshotsActionsTest-953700288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:46 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 Apr 29 06:42:46 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:46 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8 1073741824" returned: 0 in 0.865s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:46 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1de24e87-c056-4306-9e80-a0374569070a tempest-SnapshotsActionsTest-953700288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896" returned: 0 in 0.783s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-1de24e87-c056-4306-9e80-a0374569070a tempest-SnapshotsActionsTest-953700288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6627eec-d988-4f51-90cb-26ebcc610473(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:42:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1de24e87-c056-4306-9e80-a0374569070a tempest-SnapshotsActionsTest-953700288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.6e944dc1-9e54-450d-8574-9a23f796077d {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:46 devstack sudo[90482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8 Apr 29 06:42:46 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:46 devstack sudo[90483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.6e944dc1-9e54-450d-8574-9a23f796077d Apr 29 06:42:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f4235ed3-c59d-4468-8930-7ccdca41df81 tempest-VolumesGetTest-1294989752 None] Acquiring lock "cinder-b96b43fe-e564-4d88-8030-044aee87b363-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:46 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f4235ed3-c59d-4468-8930-7ccdca41df81 tempest-VolumesGetTest-1294989752 None] Lock "cinder-b96b43fe-e564-4d88-8030-044aee87b363-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f4235ed3-c59d-4468-8930-7ccdca41df81 tempest-VolumesGetTest-1294989752 None] Acquiring lock "cinder-quobyte-b96b43fe-e564-4d88-8030-044aee87b363" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f4235ed3-c59d-4468-8930-7ccdca41df81 tempest-VolumesGetTest-1294989752 None] Lock "cinder-quobyte-b96b43fe-e564-4d88-8030-044aee87b363" acquired by "delete_volume" :: waited 0.016s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:46 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1b0852-7840-4f71-b2e1-4be611de98b2]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f4235ed3-c59d-4468-8930-7ccdca41df81 tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b96b43fe-e564-4d88-8030-044aee87b363 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:46 devstack sudo[90486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b96b43fe-e564-4d88-8030-044aee87b363 Apr 29 06:42:46 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:47 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8" returned: 0 in 0.677s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:42:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4b12d9-e44d-4152-9fb3-d0d3e4379f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82116716-a06b-4f03-9c61-0f91b7b73b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:47 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Volume volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8 (b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8): created successfully Apr 29 06:42:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82116716-a06b-4f03-9c61-0f91b7b73b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Flow 'volume_create_manager' (0f95d19c-d870-4119-a631-b7db459bddd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:42:47 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-74f7a675-0ae9-434b-a66c-10671cfe858a tempest-GroupSnapshotsTest-841847317 None] Created volume successfully. Apr 29 06:42:47 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1de24e87-c056-4306-9e80-a0374569070a tempest-SnapshotsActionsTest-953700288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.6e944dc1-9e54-450d-8574-9a23f796077d" returned: 0 in 0.794s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1de24e87-c056-4306-9e80-a0374569070a tempest-SnapshotsActionsTest-953700288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.6e944dc1-9e54-450d-8574-9a23f796077d {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:47 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.6e944dc1-9e54-450d-8574-9a23f796077d Apr 29 06:42:47 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:47 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f4235ed3-c59d-4468-8930-7ccdca41df81 tempest-VolumesGetTest-1294989752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b96b43fe-e564-4d88-8030-044aee87b363" returned: 0 in 0.768s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f4235ed3-c59d-4468-8930-7ccdca41df81 tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b96b43fe-e564-4d88-8030-044aee87b363 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:47 devstack sudo[90497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b96b43fe-e564-4d88-8030-044aee87b363 Apr 29 06:42:47 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:48 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-f37a7985-bdf5-4c84-a855-27ff73563a6f tempest-GroupSnapshotsTest-841847317 None] GroupSnapshot 313af302-8a45-4009-a648-bf0381eeb7ac: creating. Apr 29 06:42:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f37a7985-bdf5-4c84-a855-27ff73563a6f tempest-GroupSnapshotsTest-841847317 None] Group snapshot 313af302-8a45-4009-a648-bf0381eeb7ac: creating. {{(pid=84195) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 06:42:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f37a7985-bdf5-4c84-a855-27ff73563a6f tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f37a7985-bdf5-4c84-a855-27ff73563a6f tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:48 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-f37a7985-bdf5-4c84-a855-27ff73563a6f tempest-GroupSnapshotsTest-841847317 None] Creating offline snapshot 9325ea7b-c023-46e2-b81f-bf9a632fc829 of volume b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8 {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:42:48 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[100cd942-3c4d-46e6-92ae-6fb23b9511ae]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f37a7985-bdf5-4c84-a855-27ff73563a6f tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:48 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1de24e87-c056-4306-9e80-a0374569070a tempest-SnapshotsActionsTest-953700288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.6e944dc1-9e54-450d-8574-9a23f796077d" returned: 0 in 0.684s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:48 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1de24e87-c056-4306-9e80-a0374569070a tempest-SnapshotsActionsTest-953700288 None] Lock "cinder-quobyte-6e944dc1-9e54-450d-8574-9a23f796077d" released by "_delete_snapshot" :: held 3.174s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:48 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1de24e87-c056-4306-9e80-a0374569070a tempest-SnapshotsActionsTest-953700288 None] Lock "cinder-quobyte-b6627eec-d988-4f51-90cb-26ebcc610473" released by "delete_snapshot" :: held 3.199s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:48 devstack sudo[90500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8 Apr 29 06:42:48 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:48 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-1de24e87-c056-4306-9e80-a0374569070a tempest-SnapshotsActionsTest-953700288 None] Created reservations ['4dafb897-f1c1-4145-b11e-1d5addde0258', '6de6f267-2b4a-4472-a626-3ed301957764', 'f00834d8-8d4d-4495-a223-5659b68860a5', '31fe7818-a472-436b-b97e-d0a6bd1c4f83'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:42:48 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-1de24e87-c056-4306-9e80-a0374569070a tempest-SnapshotsActionsTest-953700288 None] Delete snapshot completed successfully. Apr 29 06:42:48 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f4235ed3-c59d-4468-8930-7ccdca41df81 tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b96b43fe-e564-4d88-8030-044aee87b363" returned: 0 in 0.698s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:48 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1de24e87-c056-4306-9e80-a0374569070a tempest-SnapshotsActionsTest-953700288 None] Lock "cinder-6e944dc1-9e54-450d-8574-9a23f796077d-delete_snapshot" released by "delete_snapshot" :: held 3.339s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:48 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f4235ed3-c59d-4468-8930-7ccdca41df81 tempest-VolumesGetTest-1294989752 None] Lock "cinder-quobyte-b96b43fe-e564-4d88-8030-044aee87b363" released by "delete_volume" :: held 1.517s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:48 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-f4235ed3-c59d-4468-8930-7ccdca41df81 tempest-VolumesGetTest-1294989752 None] Created reservations ['d73c9838-d24a-433a-80b4-68d694786fd9', '72ad8805-858b-4820-942c-b2a1ead3c30b', '14c2c79b-c212-4c6a-9202-a473e57e4524', '593b3952-31a8-472b-b27a-557729b866e1'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:42:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f4235ed3-c59d-4468-8930-7ccdca41df81 tempest-VolumesGetTest-1294989752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f4235ed3-c59d-4468-8930-7ccdca41df81 tempest-VolumesGetTest-1294989752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:48 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f4235ed3-c59d-4468-8930-7ccdca41df81 tempest-VolumesGetTest-1294989752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:42:48 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f4235ed3-c59d-4468-8930-7ccdca41df81 tempest-VolumesGetTest-1294989752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:42:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f4235ed3-c59d-4468-8930-7ccdca41df81 tempest-VolumesGetTest-1294989752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f4235ed3-c59d-4468-8930-7ccdca41df81 tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:48 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:42:48 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:48 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f37a7985-bdf5-4c84-a855-27ff73563a6f tempest-GroupSnapshotsTest-841847317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8" returned: 0 in 0.761s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f37a7985-bdf5-4c84-a855-27ff73563a6f tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8.9325ea7b-c023-46e2-b81f-bf9a632fc829 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:48 devstack sudo[90508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8.9325ea7b-c023-46e2-b81f-bf9a632fc829 1G Apr 29 06:42:48 devstack sudo[90508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:49 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-237cc06c-046e-4337-96e9-b43b89a670dd tempest-VolumesGetTest-1294989752 None] Acquiring lock "cinder-20e9d3d5-57f9-41cb-835d-5eb24f6bd045-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:49 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-237cc06c-046e-4337-96e9-b43b89a670dd tempest-VolumesGetTest-1294989752 None] Lock "cinder-20e9d3d5-57f9-41cb-835d-5eb24f6bd045-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:49 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-237cc06c-046e-4337-96e9-b43b89a670dd tempest-VolumesGetTest-1294989752 None] Acquiring lock "cinder-quobyte-20e9d3d5-57f9-41cb-835d-5eb24f6bd045" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:49 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:49 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-237cc06c-046e-4337-96e9-b43b89a670dd tempest-VolumesGetTest-1294989752 None] Lock "cinder-quobyte-20e9d3d5-57f9-41cb-835d-5eb24f6bd045" acquired by "delete_volume" :: waited 0.025s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f4235ed3-c59d-4468-8930-7ccdca41df81 tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.706s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:49 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-f4235ed3-c59d-4468-8930-7ccdca41df81 tempest-VolumesGetTest-1294989752 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:42:49 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-f4235ed3-c59d-4468-8930-7ccdca41df81 tempest-VolumesGetTest-1294989752 None] Deleted volume successfully. Apr 29 06:42:49 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f4235ed3-c59d-4468-8930-7ccdca41df81 tempest-VolumesGetTest-1294989752 None] Lock "cinder-b96b43fe-e564-4d88-8030-044aee87b363-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:49 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66969c6-55df-40b3-8cf4-e2441fd0e68b]: (4, 'raw') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-237cc06c-046e-4337-96e9-b43b89a670dd tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:49 devstack sudo[90511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045 Apr 29 06:42:49 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-561a8fd6-d69a-4aa0-bf39-c34c3cfb8a15 tempest-SnapshotsActionsTest-302093101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:49 devstack sudo[90508]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f37a7985-bdf5-4c84-a855-27ff73563a6f tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8.9325ea7b-c023-46e2-b81f-bf9a632fc829 1G" returned: 0 in 0.858s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f37a7985-bdf5-4c84-a855-27ff73563a6f tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8.9325ea7b-c023-46e2-b81f-bf9a632fc829 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:49 devstack sudo[90517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8.9325ea7b-c023-46e2-b81f-bf9a632fc829 Apr 29 06:42:49 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:50 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-237cc06c-046e-4337-96e9-b43b89a670dd tempest-VolumesGetTest-1294989752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045" returned: 0 in 0.783s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-237cc06c-046e-4337-96e9-b43b89a670dd tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:50 devstack sudo[90521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045 Apr 29 06:42:50 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:50 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f37a7985-bdf5-4c84-a855-27ff73563a6f tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8.9325ea7b-c023-46e2-b81f-bf9a632fc829" returned: 0 in 0.677s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:50 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-f37a7985-bdf5-4c84-a855-27ff73563a6f tempest-GroupSnapshotsTest-841847317 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8.9325ea7b-c023-46e2-b81f-bf9a632fc829 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 06:42:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f37a7985-bdf5-4c84-a855-27ff73563a6f tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8.9325ea7b-c023-46e2-b81f-bf9a632fc829 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:50 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8.9325ea7b-c023-46e2-b81f-bf9a632fc829 Apr 29 06:42:50 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:50 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-237cc06c-046e-4337-96e9-b43b89a670dd tempest-VolumesGetTest-1294989752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045" returned: 1 in 0.731s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-237cc06c-046e-4337-96e9-b43b89a670dd tempest-VolumesGetTest-1294989752 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045' failed. Not Retrying. {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 06:42:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-237cc06c-046e-4337-96e9-b43b89a670dd tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:50 devstack sudo[90531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045 Apr 29 06:42:50 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:51 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f37a7985-bdf5-4c84-a855-27ff73563a6f tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8.9325ea7b-c023-46e2-b81f-bf9a632fc829" returned: 0 in 0.633s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f37a7985-bdf5-4c84-a855-27ff73563a6f tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:51 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8.info Apr 29 06:42:51 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:51 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-237cc06c-046e-4337-96e9-b43b89a670dd tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-20e9d3d5-57f9-41cb-835d-5eb24f6bd045" returned: 0 in 0.619s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:51 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-237cc06c-046e-4337-96e9-b43b89a670dd tempest-VolumesGetTest-1294989752 None] Lock "cinder-quobyte-20e9d3d5-57f9-41cb-835d-5eb24f6bd045" released by "delete_volume" :: held 2.223s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:51 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-237cc06c-046e-4337-96e9-b43b89a670dd tempest-VolumesGetTest-1294989752 None] Created reservations ['9561b1ff-2b97-48ae-b6cd-4ce9614ed16d', 'ba173726-3cd6-4640-ab10-3d79f8ceff5d', '2cbd079a-7b7c-4376-9b0a-9742b2f90ee7', 'c92d6b1a-6231-4250-8cba-94c334f7ee07'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:42:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-237cc06c-046e-4337-96e9-b43b89a670dd tempest-VolumesGetTest-1294989752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-237cc06c-046e-4337-96e9-b43b89a670dd tempest-VolumesGetTest-1294989752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:51 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-237cc06c-046e-4337-96e9-b43b89a670dd tempest-VolumesGetTest-1294989752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:42:51 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-237cc06c-046e-4337-96e9-b43b89a670dd tempest-VolumesGetTest-1294989752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:42:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-237cc06c-046e-4337-96e9-b43b89a670dd tempest-VolumesGetTest-1294989752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-237cc06c-046e-4337-96e9-b43b89a670dd tempest-VolumesGetTest-1294989752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:51 devstack sudo[90537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:42:51 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:51 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f37a7985-bdf5-4c84-a855-27ff73563a6f tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8.info" returned: 0 in 0.681s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:51 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-f37a7985-bdf5-4c84-a855-27ff73563a6f tempest-GroupSnapshotsTest-841847317 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 06:42:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f37a7985-bdf5-4c84-a855-27ff73563a6f tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:51 devstack sudo[90540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8.info Apr 29 06:42:51 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:52 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-237cc06c-046e-4337-96e9-b43b89a670dd tempest-VolumesGetTest-1294989752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.630s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:52 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-237cc06c-046e-4337-96e9-b43b89a670dd tempest-VolumesGetTest-1294989752 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:42:52 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-237cc06c-046e-4337-96e9-b43b89a670dd tempest-VolumesGetTest-1294989752 None] Deleted volume successfully. Apr 29 06:42:52 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-237cc06c-046e-4337-96e9-b43b89a670dd tempest-VolumesGetTest-1294989752 None] Lock "cinder-20e9d3d5-57f9-41cb-835d-5eb24f6bd045-delete_volume" released by "delete_volume" :: held 3.090s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:52 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f37a7985-bdf5-4c84-a855-27ff73563a6f tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8.info" returned: 0 in 0.618s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f37a7985-bdf5-4c84-a855-27ff73563a6f tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.315s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-561a8fd6-d69a-4aa0-bf39-c34c3cfb8a15 tempest-SnapshotsActionsTest-302093101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.869s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:52 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-561a8fd6-d69a-4aa0-bf39-c34c3cfb8a15 tempest-SnapshotsActionsTest-302093101 None] Creating offline snapshot 36c730b2-adbc-4236-a003-6b5a93a0103e of volume b6627eec-d988-4f51-90cb-26ebcc610473 {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:42:52 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[9589dcb0-231e-46b0-81f1-bf7400c9439c]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-561a8fd6-d69a-4aa0-bf39-c34c3cfb8a15 tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:52 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-f37a7985-bdf5-4c84-a855-27ff73563a6f tempest-GroupSnapshotsTest-841847317 None] group_snapshot 313af302-8a45-4009-a648-bf0381eeb7ac: created successfully Apr 29 06:42:52 devstack sudo[90544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 Apr 29 06:42:52 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:53 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-561a8fd6-d69a-4aa0-bf39-c34c3cfb8a15 tempest-SnapshotsActionsTest-302093101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896" returned: 0 in 0.734s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:53 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-561a8fd6-d69a-4aa0-bf39-c34c3cfb8a15 tempest-SnapshotsActionsTest-302093101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6627eec-d988-4f51-90cb-26ebcc610473(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:42:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-561a8fd6-d69a-4aa0-bf39-c34c3cfb8a15 tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.36c730b2-adbc-4236-a003-6b5a93a0103e 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:53 devstack sudo[90549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.36c730b2-adbc-4236-a003-6b5a93a0103e 1G Apr 29 06:42:53 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:53 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-ccd0731c-9461-4f2f-8b22-6f0abb22ad83 tempest-GroupSnapshotsTest-841847317 None] group_snapshot 313af302-8a45-4009-a648-bf0381eeb7ac: deleting Apr 29 06:42:53 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-ccd0731c-9461-4f2f-8b22-6f0abb22ad83 tempest-GroupSnapshotsTest-841847317 None] group_snapshot 313af302-8a45-4009-a648-bf0381eeb7ac: deleting {{(pid=84195) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 06:42:53 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ccd0731c-9461-4f2f-8b22-6f0abb22ad83 tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "cinder-quobyte-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:53 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ccd0731c-9461-4f2f-8b22-6f0abb22ad83 tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:53 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ccd0731c-9461-4f2f-8b22-6f0abb22ad83 tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "cinder-quobyte-9325ea7b-c023-46e2-b81f-bf9a632fc829" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:53 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ccd0731c-9461-4f2f-8b22-6f0abb22ad83 tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-9325ea7b-c023-46e2-b81f-bf9a632fc829" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:53 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-ccd0731c-9461-4f2f-8b22-6f0abb22ad83 tempest-GroupSnapshotsTest-841847317 None] Deleting offline snapshot 9325ea7b-c023-46e2-b81f-bf9a632fc829 of volume b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:42:53 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-ccd0731c-9461-4f2f-8b22-6f0abb22ad83 tempest-GroupSnapshotsTest-841847317 None] snapshot_file for this snap is: volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8.9325ea7b-c023-46e2-b81f-bf9a632fc829 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:42:53 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae1932c-4b08-493e-97b6-e79b3cffb4db]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ccd0731c-9461-4f2f-8b22-6f0abb22ad83 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8.9325ea7b-c023-46e2-b81f-bf9a632fc829 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:53 devstack sudo[90551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8.9325ea7b-c023-46e2-b81f-bf9a632fc829 Apr 29 06:42:53 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:54 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-561a8fd6-d69a-4aa0-bf39-c34c3cfb8a15 tempest-SnapshotsActionsTest-302093101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.36c730b2-adbc-4236-a003-6b5a93a0103e 1G" returned: 0 in 0.900s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-561a8fd6-d69a-4aa0-bf39-c34c3cfb8a15 tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.36c730b2-adbc-4236-a003-6b5a93a0103e {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:54 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.36c730b2-adbc-4236-a003-6b5a93a0103e Apr 29 06:42:54 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:54 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ccd0731c-9461-4f2f-8b22-6f0abb22ad83 tempest-GroupSnapshotsTest-841847317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8.9325ea7b-c023-46e2-b81f-bf9a632fc829" returned: 0 in 0.765s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:54 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-ccd0731c-9461-4f2f-8b22-6f0abb22ad83 tempest-GroupSnapshotsTest-841847317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:42:54 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78ceb42-dfdc-4080-ad37-c7d737cdee70]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ccd0731c-9461-4f2f-8b22-6f0abb22ad83 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:54 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8 Apr 29 06:42:54 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:54 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-561a8fd6-d69a-4aa0-bf39-c34c3cfb8a15 tempest-SnapshotsActionsTest-302093101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.36c730b2-adbc-4236-a003-6b5a93a0103e" returned: 0 in 0.721s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:54 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-561a8fd6-d69a-4aa0-bf39-c34c3cfb8a15 tempest-SnapshotsActionsTest-302093101 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.36c730b2-adbc-4236-a003-6b5a93a0103e is being set with open permissions: ugo+rw Apr 29 06:42:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-561a8fd6-d69a-4aa0-bf39-c34c3cfb8a15 tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.36c730b2-adbc-4236-a003-6b5a93a0103e {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:54 devstack sudo[90567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.36c730b2-adbc-4236-a003-6b5a93a0103e Apr 29 06:42:54 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:55 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ccd0731c-9461-4f2f-8b22-6f0abb22ad83 tempest-GroupSnapshotsTest-841847317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8" returned: 0 in 0.744s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ccd0731c-9461-4f2f-8b22-6f0abb22ad83 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8.9325ea7b-c023-46e2-b81f-bf9a632fc829 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:55 devstack sudo[90572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8.9325ea7b-c023-46e2-b81f-bf9a632fc829 Apr 29 06:42:55 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:55 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-561a8fd6-d69a-4aa0-bf39-c34c3cfb8a15 tempest-SnapshotsActionsTest-302093101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.36c730b2-adbc-4236-a003-6b5a93a0103e" returned: 0 in 0.647s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-561a8fd6-d69a-4aa0-bf39-c34c3cfb8a15 tempest-SnapshotsActionsTest-302093101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.123s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:55 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-561a8fd6-d69a-4aa0-bf39-c34c3cfb8a15 tempest-SnapshotsActionsTest-302093101 None] Create snapshot completed successfully Apr 29 06:42:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3d6c8363-3b1f-45e5-99c2-c67051b075c1 tempest-SnapshotsActionsTest-953700288 None] Acquiring lock "cinder-36c730b2-adbc-4236-a003-6b5a93a0103e-delete_snapshot" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3d6c8363-3b1f-45e5-99c2-c67051b075c1 tempest-SnapshotsActionsTest-953700288 None] Lock "cinder-36c730b2-adbc-4236-a003-6b5a93a0103e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3d6c8363-3b1f-45e5-99c2-c67051b075c1 tempest-SnapshotsActionsTest-953700288 None] Acquiring lock "cinder-quobyte-b6627eec-d988-4f51-90cb-26ebcc610473" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3d6c8363-3b1f-45e5-99c2-c67051b075c1 tempest-SnapshotsActionsTest-953700288 None] Lock "cinder-quobyte-b6627eec-d988-4f51-90cb-26ebcc610473" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3d6c8363-3b1f-45e5-99c2-c67051b075c1 tempest-SnapshotsActionsTest-953700288 None] Acquiring lock "cinder-quobyte-36c730b2-adbc-4236-a003-6b5a93a0103e" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3d6c8363-3b1f-45e5-99c2-c67051b075c1 tempest-SnapshotsActionsTest-953700288 None] Lock "cinder-quobyte-36c730b2-adbc-4236-a003-6b5a93a0103e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:55 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-3d6c8363-3b1f-45e5-99c2-c67051b075c1 tempest-SnapshotsActionsTest-953700288 None] Deleting offline snapshot 36c730b2-adbc-4236-a003-6b5a93a0103e of volume b6627eec-d988-4f51-90cb-26ebcc610473 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:42:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-3d6c8363-3b1f-45e5-99c2-c67051b075c1 tempest-SnapshotsActionsTest-953700288 None] snapshot_file for this snap is: volume-b6627eec-d988-4f51-90cb-26ebcc610473.36c730b2-adbc-4236-a003-6b5a93a0103e {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:42:56 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[069c8ecf-bcdf-4d7a-8467-a47399d883c7]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3d6c8363-3b1f-45e5-99c2-c67051b075c1 tempest-SnapshotsActionsTest-953700288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.36c730b2-adbc-4236-a003-6b5a93a0103e {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:56 devstack sudo[90579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.36c730b2-adbc-4236-a003-6b5a93a0103e Apr 29 06:42:56 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:56 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ccd0731c-9461-4f2f-8b22-6f0abb22ad83 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8.9325ea7b-c023-46e2-b81f-bf9a632fc829" returned: 0 in 0.787s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ccd0731c-9461-4f2f-8b22-6f0abb22ad83 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8.9325ea7b-c023-46e2-b81f-bf9a632fc829 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:56 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8.9325ea7b-c023-46e2-b81f-bf9a632fc829 Apr 29 06:42:56 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:56 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ccd0731c-9461-4f2f-8b22-6f0abb22ad83 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8.9325ea7b-c023-46e2-b81f-bf9a632fc829" returned: 0 in 0.636s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:56 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ccd0731c-9461-4f2f-8b22-6f0abb22ad83 tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-9325ea7b-c023-46e2-b81f-bf9a632fc829" released by "_delete_snapshot" :: held 3.071s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:56 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ccd0731c-9461-4f2f-8b22-6f0abb22ad83 tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8" released by "delete_snapshot" :: held 3.114s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:56 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3d6c8363-3b1f-45e5-99c2-c67051b075c1 tempest-SnapshotsActionsTest-953700288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.36c730b2-adbc-4236-a003-6b5a93a0103e" returned: 0 in 0.841s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-3d6c8363-3b1f-45e5-99c2-c67051b075c1 tempest-SnapshotsActionsTest-953700288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6627eec-d988-4f51-90cb-26ebcc610473(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:42:56 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b23ddf-d725-417f-9354-49a26daa4427]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3d6c8363-3b1f-45e5-99c2-c67051b075c1 tempest-SnapshotsActionsTest-953700288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:56 devstack cinder-volume[84195]: WARNING cinder.quota [None req-ccd0731c-9461-4f2f-8b22-6f0abb22ad83 tempest-GroupSnapshotsTest-841847317 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1619231403 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1619231403, it is now deprecated. Please use the default quota class for default quota. Apr 29 06:42:56 devstack cinder-volume[84195]: WARNING cinder.quota [None req-ccd0731c-9461-4f2f-8b22-6f0abb22ad83 tempest-GroupSnapshotsTest-841847317 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1619231403 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1619231403, it is now deprecated. Please use the default quota class for default quota. Apr 29 06:42:57 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-ccd0731c-9461-4f2f-8b22-6f0abb22ad83 tempest-GroupSnapshotsTest-841847317 None] Created reservations ['51141ac2-61bd-4246-80c2-c2864896e972', '014f2819-382e-4ef6-b484-605f97a7fdfd', 'ac82ffab-da7a-4099-b2d8-ef1572e1185b', '7c80e15c-71d9-4e11-b23e-081286573231'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:42:57 devstack sudo[90588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 Apr 29 06:42:57 devstack sudo[90588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:57 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-ccd0731c-9461-4f2f-8b22-6f0abb22ad83 tempest-GroupSnapshotsTest-841847317 None] group_snapshot 313af302-8a45-4009-a648-bf0381eeb7ac: deleted successfully Apr 29 06:42:57 devstack sudo[90588]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3d6c8363-3b1f-45e5-99c2-c67051b075c1 tempest-SnapshotsActionsTest-953700288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896" returned: 0 in 0.806s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:57 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-3d6c8363-3b1f-45e5-99c2-c67051b075c1 tempest-SnapshotsActionsTest-953700288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6627eec-d988-4f51-90cb-26ebcc610473(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:42:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3d6c8363-3b1f-45e5-99c2-c67051b075c1 tempest-SnapshotsActionsTest-953700288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.36c730b2-adbc-4236-a003-6b5a93a0103e {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:57 devstack sudo[90593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.36c730b2-adbc-4236-a003-6b5a93a0103e Apr 29 06:42:57 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:57 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:42:58 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Flow 'volume_create_manager' (380231df-ddc4-48bf-bbf0-7f17378a8924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:42:58 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35c0c90-a0b9-4b01-a884-c1f3651f499c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:58 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35c0c90-a0b9-4b01-a884-c1f3651f499c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-634451094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154626d3-ecf8-4b1b-8ec3-49edb8332f9f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='db23e9ee24c54c069b722353c6ecd4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:42:58Z,use_quota=True,user_id='38727ce8d85b4f2c80f335dfbc247f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:58 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f6f1f3c-c0bb-44e7-a263-531d47bfed27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:58 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f6f1f3c-c0bb-44e7-a263-531d47bfed27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:58 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0515b39-f9fd-45ca-92c8-067d13b796cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:58 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0515b39-f9fd-45ca-92c8-067d13b796cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '154626d3-ecf8-4b1b-8ec3-49edb8332f9f', 'volume_name': 'volume-154626d3-ecf8-4b1b-8ec3-49edb8332f9f', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:58 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14304668-1a43-45af-97ea-3850b043cece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:58 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14304668-1a43-45af-97ea-3850b043cece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:58 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7800ae9c-65da-4f97-ab9d-bb0832686abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:58 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Volume 154626d3-ecf8-4b1b-8ec3-49edb8332f9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-154626d3-ecf8-4b1b-8ec3-49edb8332f9f', 'volume_size': 1} Apr 29 06:42:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:58 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-634451094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154626d3-ecf8-4b1b-8ec3-49edb8332f9f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='db23e9ee24c54c069b722353c6ecd4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:42:58Z,use_quota=True,user_id='38727ce8d85b4f2c80f335dfbc247f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:42:58 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Creating volume 154626d3-ecf8-4b1b-8ec3-49edb8332f9f {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:42:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:42:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:42:58 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:42:58 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:42:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:58 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:42:58 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:42:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-154626d3-ecf8-4b1b-8ec3-49edb8332f9f 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:58 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-154626d3-ecf8-4b1b-8ec3-49edb8332f9f 1073741824 Apr 29 06:42:58 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:58 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-a67b9ef2-f199-4f0d-83ed-bb7dcf4957f3 tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "cinder-quobyte-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:42:58 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-a67b9ef2-f199-4f0d-83ed-bb7dcf4957f3 tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8" acquired by "delete_volume" :: waited 0.017s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:42:58 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57fe067-d6b5-4d25-88bc-74028d7efe06]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:42:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a67b9ef2-f199-4f0d-83ed-bb7dcf4957f3 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:58 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8 Apr 29 06:42:58 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:58 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3d6c8363-3b1f-45e5-99c2-c67051b075c1 tempest-SnapshotsActionsTest-953700288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.36c730b2-adbc-4236-a003-6b5a93a0103e" returned: 0 in 0.856s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3d6c8363-3b1f-45e5-99c2-c67051b075c1 tempest-SnapshotsActionsTest-953700288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.36c730b2-adbc-4236-a003-6b5a93a0103e {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:58 devstack sudo[90602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.36c730b2-adbc-4236-a003-6b5a93a0103e Apr 29 06:42:58 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:58 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-154626d3-ecf8-4b1b-8ec3-49edb8332f9f 1073741824" returned: 0 in 0.891s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-154626d3-ecf8-4b1b-8ec3-49edb8332f9f {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:59 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-154626d3-ecf8-4b1b-8ec3-49edb8332f9f Apr 29 06:42:59 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:59 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a67b9ef2-f199-4f0d-83ed-bb7dcf4957f3 tempest-GroupSnapshotsTest-841847317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8" returned: 0 in 0.811s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a67b9ef2-f199-4f0d-83ed-bb7dcf4957f3 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:42:59 devstack sudo[90613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8 Apr 29 06:42:59 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:42:59 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3d6c8363-3b1f-45e5-99c2-c67051b075c1 tempest-SnapshotsActionsTest-953700288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.36c730b2-adbc-4236-a003-6b5a93a0103e" returned: 0 in 0.653s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:59 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3d6c8363-3b1f-45e5-99c2-c67051b075c1 tempest-SnapshotsActionsTest-953700288 None] Lock "cinder-quobyte-36c730b2-adbc-4236-a003-6b5a93a0103e" released by "_delete_snapshot" :: held 3.263s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:59 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3d6c8363-3b1f-45e5-99c2-c67051b075c1 tempest-SnapshotsActionsTest-953700288 None] Lock "cinder-quobyte-b6627eec-d988-4f51-90cb-26ebcc610473" released by "delete_snapshot" :: held 3.289s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:59 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-3d6c8363-3b1f-45e5-99c2-c67051b075c1 tempest-SnapshotsActionsTest-953700288 None] Created reservations ['dc6f0d7a-8136-4653-855a-59605fd611c2', '364d3a38-3a2e-4fff-86ab-19608a341ef4', '646687d8-52eb-470d-bcc9-ca4ec20cc4a6', '4d4acc12-815e-4ba6-95af-15d714b19d7a'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:42:59 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-3d6c8363-3b1f-45e5-99c2-c67051b075c1 tempest-SnapshotsActionsTest-953700288 None] Delete snapshot completed successfully. Apr 29 06:42:59 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3d6c8363-3b1f-45e5-99c2-c67051b075c1 tempest-SnapshotsActionsTest-953700288 None] Lock "cinder-36c730b2-adbc-4236-a003-6b5a93a0103e-delete_snapshot" released by "delete_snapshot" :: held 3.430s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:59 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-154626d3-ecf8-4b1b-8ec3-49edb8332f9f" returned: 0 in 0.636s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:59 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:42:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:42:59 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7800ae9c-65da-4f97-ab9d-bb0832686abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-154626d3-ecf8-4b1b-8ec3-49edb8332f9f', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:59 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a6eaa7f-0725-4ba5-a10a-4318d55069e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:42:59 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Volume volume-154626d3-ecf8-4b1b-8ec3-49edb8332f9f (154626d3-ecf8-4b1b-8ec3-49edb8332f9f): created successfully Apr 29 06:42:59 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a6eaa7f-0725-4ba5-a10a-4318d55069e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:42:59 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Flow 'volume_create_manager' (380231df-ddc4-48bf-bbf0-7f17378a8924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:42:59 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-4ececbcd-ed66-42e5-9f41-afe320bb34d9 tempest-VolumesListTestJSON-962870651 None] Created volume successfully. Apr 29 06:42:59 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root Apr 29 06:42:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a67b9ef2-f199-4f0d-83ed-bb7dcf4957f3 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8" returned: 0 in 0.695s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:42:59 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-a67b9ef2-f199-4f0d-83ed-bb7dcf4957f3 tempest-GroupSnapshotsTest-841847317 None] Lock "cinder-quobyte-b4b3a04a-9814-4ccc-a5e5-0fa385a8beb8" released by "delete_volume" :: held 1.576s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:42:59 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-a67b9ef2-f199-4f0d-83ed-bb7dcf4957f3 tempest-GroupSnapshotsTest-841847317 None] Created reservations ['efea98d3-8b84-43bb-a169-97dd139ac885'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:42:59 devstack cinder-volume[84195]: WARNING cinder.quota [None req-a67b9ef2-f199-4f0d-83ed-bb7dcf4957f3 tempest-GroupSnapshotsTest-841847317 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1619231403 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1619231403, it is now deprecated. Please use the default quota class for default quota. Apr 29 06:42:59 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-a67b9ef2-f199-4f0d-83ed-bb7dcf4957f3 tempest-GroupSnapshotsTest-841847317 None] Created reservations ['c4803dcc-02ed-4f9b-996c-d8e1dcbb3e84', '8734c8b4-7308-415c-a26d-b6ff20d2dfc2', '86eee80c-562c-4390-90ac-7c428d440509', 'af6c734f-f2f8-4211-99b4-12c6992c4fdf'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:43:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a67b9ef2-f199-4f0d-83ed-bb7dcf4957f3 tempest-GroupSnapshotsTest-841847317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a67b9ef2-f199-4f0d-83ed-bb7dcf4957f3 tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:00 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-a67b9ef2-f199-4f0d-83ed-bb7dcf4957f3 tempest-GroupSnapshotsTest-841847317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:43:00 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-a67b9ef2-f199-4f0d-83ed-bb7dcf4957f3 tempest-GroupSnapshotsTest-841847317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:43:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a67b9ef2-f199-4f0d-83ed-bb7dcf4957f3 tempest-GroupSnapshotsTest-841847317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a67b9ef2-f199-4f0d-83ed-bb7dcf4957f3 tempest-GroupSnapshotsTest-841847317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:00 devstack sudo[90617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:43:00 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d9a5439c-229a-4953-a2d1-ebdd01ebeb26 tempest-SnapshotsActionsTest-302093101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d9a5439c-229a-4953-a2d1-ebdd01ebeb26 tempest-SnapshotsActionsTest-302093101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:00 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-d9a5439c-229a-4953-a2d1-ebdd01ebeb26 tempest-SnapshotsActionsTest-302093101 None] Creating offline snapshot 998989e8-65e9-4040-b3d8-848ee5357dfb of volume b6627eec-d988-4f51-90cb-26ebcc610473 {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:43:00 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a183905-53db-4723-9af8-6ff1eb545e52]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:43:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d9a5439c-229a-4953-a2d1-ebdd01ebeb26 tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:00 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:43:00 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:00 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Flow 'volume_create_manager' (31351c95-be51-4c99-ac08-a1bdae2a1c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:43:00 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (794134c9-8c7e-4f85-af06-d317b7d31dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a67b9ef2-f199-4f0d-83ed-bb7dcf4957f3 tempest-GroupSnapshotsTest-841847317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.670s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:00 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-a67b9ef2-f199-4f0d-83ed-bb7dcf4957f3 tempest-GroupSnapshotsTest-841847317 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:43:00 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (794134c9-8c7e-4f85-af06-d317b7d31dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1403252178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4224bbbb-37bb-453b-b0eb-a275badec5fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='db23e9ee24c54c069b722353c6ecd4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:43:01Z,use_quota=True,user_id='38727ce8d85b4f2c80f335dfbc247f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:00 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdf5bd42-6ad4-43ba-ad8c-b9062fb7d48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:00 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdf5bd42-6ad4-43ba-ad8c-b9062fb7d48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:00 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca804ea3-a68e-4c9a-9243-5df94d36bbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:00 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca804ea3-a68e-4c9a-9243-5df94d36bbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4224bbbb-37bb-453b-b0eb-a275badec5fc', 'volume_name': 'volume-4224bbbb-37bb-453b-b0eb-a275badec5fc', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:00 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0decef4-e274-497d-8382-13ad98f0d511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:00 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0decef4-e274-497d-8382-13ad98f0d511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:00 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006df07d-9425-4c38-a5a9-096abbee9429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:00 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Volume 4224bbbb-37bb-453b-b0eb-a275badec5fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4224bbbb-37bb-453b-b0eb-a275badec5fc', 'volume_size': 1} Apr 29 06:43:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:00 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-a67b9ef2-f199-4f0d-83ed-bb7dcf4957f3 tempest-GroupSnapshotsTest-841847317 None] Delete group completed successfully. Apr 29 06:43:00 devstack sudo[90622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 Apr 29 06:43:00 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:01 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d9a5439c-229a-4953-a2d1-ebdd01ebeb26 tempest-SnapshotsActionsTest-302093101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896" returned: 0 in 0.761s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:01 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-d9a5439c-229a-4953-a2d1-ebdd01ebeb26 tempest-SnapshotsActionsTest-302093101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6627eec-d988-4f51-90cb-26ebcc610473(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:43:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d9a5439c-229a-4953-a2d1-ebdd01ebeb26 tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.998989e8-65e9-4040-b3d8-848ee5357dfb 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:01 devstack sudo[90627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.998989e8-65e9-4040-b3d8-848ee5357dfb 1G Apr 29 06:43:01 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:02 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d9a5439c-229a-4953-a2d1-ebdd01ebeb26 tempest-SnapshotsActionsTest-302093101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.998989e8-65e9-4040-b3d8-848ee5357dfb 1G" returned: 0 in 0.911s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d9a5439c-229a-4953-a2d1-ebdd01ebeb26 tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.998989e8-65e9-4040-b3d8-848ee5357dfb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:02 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.998989e8-65e9-4040-b3d8-848ee5357dfb Apr 29 06:43:02 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:03 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d9a5439c-229a-4953-a2d1-ebdd01ebeb26 tempest-SnapshotsActionsTest-302093101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.998989e8-65e9-4040-b3d8-848ee5357dfb" returned: 0 in 0.759s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:03 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-d9a5439c-229a-4953-a2d1-ebdd01ebeb26 tempest-SnapshotsActionsTest-302093101 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.998989e8-65e9-4040-b3d8-848ee5357dfb is being set with open permissions: ugo+rw Apr 29 06:43:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d9a5439c-229a-4953-a2d1-ebdd01ebeb26 tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.998989e8-65e9-4040-b3d8-848ee5357dfb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:03 devstack sudo[90638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.998989e8-65e9-4040-b3d8-848ee5357dfb Apr 29 06:43:03 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:03 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d9a5439c-229a-4953-a2d1-ebdd01ebeb26 tempest-SnapshotsActionsTest-302093101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.998989e8-65e9-4040-b3d8-848ee5357dfb" returned: 0 in 0.667s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d9a5439c-229a-4953-a2d1-ebdd01ebeb26 tempest-SnapshotsActionsTest-302093101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.225s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.022s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:03 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1403252178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4224bbbb-37bb-453b-b0eb-a275badec5fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='db23e9ee24c54c069b722353c6ecd4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:43:01Z,use_quota=True,user_id='38727ce8d85b4f2c80f335dfbc247f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:43:03 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Creating volume 4224bbbb-37bb-453b-b0eb-a275badec5fc {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:43:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:03 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:43:03 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:43:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:03 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:43:03 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:43:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-4224bbbb-37bb-453b-b0eb-a275badec5fc 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:03 devstack sudo[90641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-4224bbbb-37bb-453b-b0eb-a275badec5fc 1073741824 Apr 29 06:43:03 devstack sudo[90641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:03 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-d9a5439c-229a-4953-a2d1-ebdd01ebeb26 tempest-SnapshotsActionsTest-302093101 None] Create snapshot completed successfully Apr 29 06:43:04 devstack sudo[90641]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-4224bbbb-37bb-453b-b0eb-a275badec5fc 1073741824" returned: 0 in 0.828s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-4224bbbb-37bb-453b-b0eb-a275badec5fc {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:04 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-4224bbbb-37bb-453b-b0eb-a275badec5fc Apr 29 06:43:04 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:04 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-15ee1d32-6c99-49fc-a04e-db67234ce81f tempest-SnapshotsActionsTest-953700288 None] Acquiring lock "cinder-998989e8-65e9-4040-b3d8-848ee5357dfb-delete_snapshot" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:04 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-15ee1d32-6c99-49fc-a04e-db67234ce81f tempest-SnapshotsActionsTest-953700288 None] Lock "cinder-998989e8-65e9-4040-b3d8-848ee5357dfb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:04 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-15ee1d32-6c99-49fc-a04e-db67234ce81f tempest-SnapshotsActionsTest-953700288 None] Acquiring lock "cinder-quobyte-b6627eec-d988-4f51-90cb-26ebcc610473" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:04 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-15ee1d32-6c99-49fc-a04e-db67234ce81f tempest-SnapshotsActionsTest-953700288 None] Lock "cinder-quobyte-b6627eec-d988-4f51-90cb-26ebcc610473" acquired by "delete_snapshot" :: waited 0.026s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:04 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-15ee1d32-6c99-49fc-a04e-db67234ce81f tempest-SnapshotsActionsTest-953700288 None] Acquiring lock "cinder-quobyte-998989e8-65e9-4040-b3d8-848ee5357dfb" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:04 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-15ee1d32-6c99-49fc-a04e-db67234ce81f tempest-SnapshotsActionsTest-953700288 None] Lock "cinder-quobyte-998989e8-65e9-4040-b3d8-848ee5357dfb" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-15ee1d32-6c99-49fc-a04e-db67234ce81f tempest-SnapshotsActionsTest-953700288 None] Deleting offline snapshot 998989e8-65e9-4040-b3d8-848ee5357dfb of volume b6627eec-d988-4f51-90cb-26ebcc610473 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:43:05 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-15ee1d32-6c99-49fc-a04e-db67234ce81f tempest-SnapshotsActionsTest-953700288 None] snapshot_file for this snap is: volume-b6627eec-d988-4f51-90cb-26ebcc610473.998989e8-65e9-4040-b3d8-848ee5357dfb {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:43:05 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[6793e371-1f78-4631-8541-41146ced1df7]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:43:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-15ee1d32-6c99-49fc-a04e-db67234ce81f tempest-SnapshotsActionsTest-953700288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.998989e8-65e9-4040-b3d8-848ee5357dfb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:05 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.998989e8-65e9-4040-b3d8-848ee5357dfb Apr 29 06:43:05 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:05 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-4224bbbb-37bb-453b-b0eb-a275badec5fc" returned: 0 in 0.648s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:05 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:43:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006df07d-9425-4c38-a5a9-096abbee9429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4224bbbb-37bb-453b-b0eb-a275badec5fc', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba35a3e5-d738-463b-9af6-1a1d18332ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:05 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Volume volume-4224bbbb-37bb-453b-b0eb-a275badec5fc (4224bbbb-37bb-453b-b0eb-a275badec5fc): created successfully Apr 29 06:43:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba35a3e5-d738-463b-9af6-1a1d18332ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Flow 'volume_create_manager' (31351c95-be51-4c99-ac08-a1bdae2a1c77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:43:05 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-90685b1a-89e1-4d78-80aa-d768d5f5d97e tempest-VolumesListTestJSON-962870651 None] Created volume successfully. Apr 29 06:43:05 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-ba9fad0d-ee54-4777-a102-59d4fc7aa84c tempest-GroupSnapshotsV319Test-1468295452 None] Group tempest-GroupSnapshotsV319Test-Group-635812557: creating Apr 29 06:43:05 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-ba9fad0d-ee54-4777-a102-59d4fc7aa84c tempest-GroupSnapshotsV319Test-1468295452 None] Group tempest-GroupSnapshotsV319Test-Group-635812557: created successfully Apr 29 06:43:05 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-ba9fad0d-ee54-4777-a102-59d4fc7aa84c tempest-GroupSnapshotsV319Test-1468295452 None] Create group completed successfully. Apr 29 06:43:05 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-15ee1d32-6c99-49fc-a04e-db67234ce81f tempest-SnapshotsActionsTest-953700288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.998989e8-65e9-4040-b3d8-848ee5357dfb" returned: 0 in 0.777s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:05 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-15ee1d32-6c99-49fc-a04e-db67234ce81f tempest-SnapshotsActionsTest-953700288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6627eec-d988-4f51-90cb-26ebcc610473(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:43:05 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd3dc00-2beb-4c44-b037-e5583702b515]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:43:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-15ee1d32-6c99-49fc-a04e-db67234ce81f tempest-SnapshotsActionsTest-953700288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:05 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 Apr 29 06:43:05 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:06 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:43:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Flow 'volume_create_manager' (d32cf1bf-3a4a-43a6-8762-7aecd2cc0b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:43:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910153d9-9301-4bb8-8b3b-7698435d8e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910153d9-9301-4bb8-8b3b-7698435d8e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1673977441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c94bcf-b0ad-49bf-bcb1-d2a031b1aafc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='db23e9ee24c54c069b722353c6ecd4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:43:06Z,use_quota=True,user_id='38727ce8d85b4f2c80f335dfbc247f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f008ce3-3a7e-4d81-9789-ae84b710ad8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f008ce3-3a7e-4d81-9789-ae84b710ad8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d2b1338-6a9e-46ae-91c0-fbb540e22fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d2b1338-6a9e-46ae-91c0-fbb540e22fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0c94bcf-b0ad-49bf-bcb1-d2a031b1aafc', 'volume_name': 'volume-a0c94bcf-b0ad-49bf-bcb1-d2a031b1aafc', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0adb8ff-e937-4f99-8163-23386b9385b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0adb8ff-e937-4f99-8163-23386b9385b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e160823-f98e-4a6a-81f6-94312fabe8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:06 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Volume a0c94bcf-b0ad-49bf-bcb1-d2a031b1aafc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0c94bcf-b0ad-49bf-bcb1-d2a031b1aafc', 'volume_size': 1} Apr 29 06:43:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:06 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1673977441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c94bcf-b0ad-49bf-bcb1-d2a031b1aafc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='db23e9ee24c54c069b722353c6ecd4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:43:06Z,use_quota=True,user_id='38727ce8d85b4f2c80f335dfbc247f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:43:06 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Creating volume a0c94bcf-b0ad-49bf-bcb1-d2a031b1aafc {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:43:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:06 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:43:06 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:43:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:06 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:43:06 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:43:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a0c94bcf-b0ad-49bf-bcb1-d2a031b1aafc 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:06 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a0c94bcf-b0ad-49bf-bcb1-d2a031b1aafc 1073741824 Apr 29 06:43:06 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:06 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-15ee1d32-6c99-49fc-a04e-db67234ce81f tempest-SnapshotsActionsTest-953700288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896" returned: 0 in 0.767s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:06 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-15ee1d32-6c99-49fc-a04e-db67234ce81f tempest-SnapshotsActionsTest-953700288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6627eec-d988-4f51-90cb-26ebcc610473(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:43:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-15ee1d32-6c99-49fc-a04e-db67234ce81f tempest-SnapshotsActionsTest-953700288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.998989e8-65e9-4040-b3d8-848ee5357dfb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:06 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.998989e8-65e9-4040-b3d8-848ee5357dfb Apr 29 06:43:06 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:07 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:43:07 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Flow 'volume_create_manager' (de5de08d-1d2b-4b45-a918-a6655d889d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:43:07 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa40188-361b-47f5-a5aa-7576ea16de96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:07 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa40188-361b-47f5-a5aa-7576ea16de96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1267171898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=702cd333-f38d-4db9-a02c-10039f9711dd,host='devstack@QuobyteHD#QuobyteHD',id=7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24b64b89e524b688d6e9cc17cd659ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:43:07Z,use_quota=True,user_id='f671c1a9ed4b4b6baadd2dd2f9eca826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64702218-2ace-4576-b226-da9adc2ad30c),volume_type_id=64702218-2ace-4576-b226-da9adc2ad30c)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:07 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (357ca6c2-efbf-4c5a-90f8-1d13e2c21f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:07 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (357ca6c2-efbf-4c5a-90f8-1d13e2c21f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:07 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca14486-eaab-4dd5-9ab7-5022255e6807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:07 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca14486-eaab-4dd5-9ab7-5022255e6807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d', 'volume_name': 'volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:07 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d49894cf-d61c-4379-a259-52cf08a745e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:07 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d49894cf-d61c-4379-a259-52cf08a745e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:07 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e8bb50-90b8-471f-8c16-d90f0311d759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:07 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Volume 7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d', 'volume_size': 1} Apr 29 06:43:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:07 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a0c94bcf-b0ad-49bf-bcb1-d2a031b1aafc 1073741824" returned: 0 in 0.883s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a0c94bcf-b0ad-49bf-bcb1-d2a031b1aafc {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:07 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:07 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a0c94bcf-b0ad-49bf-bcb1-d2a031b1aafc Apr 29 06:43:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-15ee1d32-6c99-49fc-a04e-db67234ce81f tempest-SnapshotsActionsTest-953700288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.998989e8-65e9-4040-b3d8-848ee5357dfb" returned: 0 in 0.829s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-15ee1d32-6c99-49fc-a04e-db67234ce81f tempest-SnapshotsActionsTest-953700288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.998989e8-65e9-4040-b3d8-848ee5357dfb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:07 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:07 devstack sudo[90674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.998989e8-65e9-4040-b3d8-848ee5357dfb Apr 29 06:43:07 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:08 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a0c94bcf-b0ad-49bf-bcb1-d2a031b1aafc" returned: 0 in 0.623s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:43:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.802s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=702cd333-f38d-4db9-a02c-10039f9711dd,created_at=2026-04-29T04:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1267171898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=702cd333-f38d-4db9-a02c-10039f9711dd,host='devstack@QuobyteHD#QuobyteHD',id=7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24b64b89e524b688d6e9cc17cd659ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:43:07Z,use_quota=True,user_id='f671c1a9ed4b4b6baadd2dd2f9eca826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64702218-2ace-4576-b226-da9adc2ad30c),volume_type_id=64702218-2ace-4576-b226-da9adc2ad30c)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:43:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Creating volume 7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:43:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:43:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:43:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:43:08 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:43:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:08 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-15ee1d32-6c99-49fc-a04e-db67234ce81f tempest-SnapshotsActionsTest-953700288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.998989e8-65e9-4040-b3d8-848ee5357dfb" returned: 0 in 0.624s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:08 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d 1073741824 Apr 29 06:43:08 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e160823-f98e-4a6a-81f6-94312fabe8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0c94bcf-b0ad-49bf-bcb1-d2a031b1aafc', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31566fc5-99c7-4aaf-a832-cde527da77ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:08 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-15ee1d32-6c99-49fc-a04e-db67234ce81f tempest-SnapshotsActionsTest-953700288 None] Lock "cinder-quobyte-998989e8-65e9-4040-b3d8-848ee5357dfb" released by "_delete_snapshot" :: held 3.121s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:08 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-15ee1d32-6c99-49fc-a04e-db67234ce81f tempest-SnapshotsActionsTest-953700288 None] Lock "cinder-quobyte-b6627eec-d988-4f51-90cb-26ebcc610473" released by "delete_snapshot" :: held 3.150s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:08 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Volume volume-a0c94bcf-b0ad-49bf-bcb1-d2a031b1aafc (a0c94bcf-b0ad-49bf-bcb1-d2a031b1aafc): created successfully Apr 29 06:43:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31566fc5-99c7-4aaf-a832-cde527da77ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Flow 'volume_create_manager' (d32cf1bf-3a4a-43a6-8762-7aecd2cc0b70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:43:08 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-21fb049d-9040-4637-b94e-501607436342 tempest-VolumesListTestJSON-962870651 None] Created volume successfully. Apr 29 06:43:08 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-15ee1d32-6c99-49fc-a04e-db67234ce81f tempest-SnapshotsActionsTest-953700288 None] Created reservations ['14859384-0593-4349-b918-227efb6c7b63', '743c79e7-77c0-482e-9811-a8f26bc14e73', 'c7691caa-11ab-4cf2-94eb-1e0edb922ae0', '0b8370ef-685c-4885-8e6e-a6b0d14872f3'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:43:08 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-15ee1d32-6c99-49fc-a04e-db67234ce81f tempest-SnapshotsActionsTest-953700288 None] Delete snapshot completed successfully. Apr 29 06:43:08 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-15ee1d32-6c99-49fc-a04e-db67234ce81f tempest-SnapshotsActionsTest-953700288 None] Lock "cinder-998989e8-65e9-4040-b3d8-848ee5357dfb-delete_snapshot" released by "delete_snapshot" :: held 3.326s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:08 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d 1073741824" returned: 0 in 0.819s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:08 devstack sudo[90684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d Apr 29 06:43:08 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:09 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d" returned: 0 in 0.613s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:09 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:43:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e8bb50-90b8-471f-8c16-d90f0311d759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f88c42-86d8-46e3-ad55-c5cef5ec353a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:09 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Volume volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d (7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d): created successfully Apr 29 06:43:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f88c42-86d8-46e3-ad55-c5cef5ec353a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Flow 'volume_create_manager' (de5de08d-1d2b-4b45-a918-a6655d889d66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:43:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8f3ec59b-b376-4d7c-9fb3-eb051edb6378 tempest-SnapshotsActionsTest-302093101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8f3ec59b-b376-4d7c-9fb3-eb051edb6378 tempest-SnapshotsActionsTest-302093101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:09 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-51fefb86-25fb-4363-8da4-e516176cde7b tempest-GroupSnapshotsV319Test-1468295452 None] Created volume successfully. Apr 29 06:43:09 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-8f3ec59b-b376-4d7c-9fb3-eb051edb6378 tempest-SnapshotsActionsTest-302093101 None] Creating offline snapshot 5b126e67-8031-4745-a36b-4f3a8a14cacb of volume b6627eec-d988-4f51-90cb-26ebcc610473 {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:43:09 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b62d948-6613-4514-adcf-2179553007fa]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:43:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8f3ec59b-b376-4d7c-9fb3-eb051edb6378 tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:09 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 Apr 29 06:43:09 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:10 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8f3ec59b-b376-4d7c-9fb3-eb051edb6378 tempest-SnapshotsActionsTest-302093101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896" returned: 0 in 0.726s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:10 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-8f3ec59b-b376-4d7c-9fb3-eb051edb6378 tempest-SnapshotsActionsTest-302093101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6627eec-d988-4f51-90cb-26ebcc610473(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:43:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8f3ec59b-b376-4d7c-9fb3-eb051edb6378 tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.5b126e67-8031-4745-a36b-4f3a8a14cacb 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:10 devstack sudo[90692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.5b126e67-8031-4745-a36b-4f3a8a14cacb 1G Apr 29 06:43:10 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:10 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-705424be-3f29-4d6f-a026-31289da14888 tempest-GroupSnapshotsV319Test-1468295452 None] GroupSnapshot 00ff15bf-2366-488f-bf39-1aa2d4dcb934: creating. Apr 29 06:43:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-705424be-3f29-4d6f-a026-31289da14888 tempest-GroupSnapshotsV319Test-1468295452 None] Group snapshot 00ff15bf-2366-488f-bf39-1aa2d4dcb934: creating. {{(pid=84195) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 06:43:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-705424be-3f29-4d6f-a026-31289da14888 tempest-GroupSnapshotsV319Test-1468295452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:10 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5140a355-95ff-4d91-84b2-4d9438984a5b tempest-VolumesListTestJSON-962870651 None] Acquiring lock "cinder-a0c94bcf-b0ad-49bf-bcb1-d2a031b1aafc-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:10 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5140a355-95ff-4d91-84b2-4d9438984a5b tempest-VolumesListTestJSON-962870651 None] Lock "cinder-a0c94bcf-b0ad-49bf-bcb1-d2a031b1aafc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:10 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5140a355-95ff-4d91-84b2-4d9438984a5b tempest-VolumesListTestJSON-962870651 None] Acquiring lock "cinder-quobyte-a0c94bcf-b0ad-49bf-bcb1-d2a031b1aafc" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:10 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5140a355-95ff-4d91-84b2-4d9438984a5b tempest-VolumesListTestJSON-962870651 None] Lock "cinder-quobyte-a0c94bcf-b0ad-49bf-bcb1-d2a031b1aafc" acquired by "delete_volume" :: waited 0.016s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:11 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[969d2e62-0692-439d-b806-93377335d2ce]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:43:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5140a355-95ff-4d91-84b2-4d9438984a5b tempest-VolumesListTestJSON-962870651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a0c94bcf-b0ad-49bf-bcb1-d2a031b1aafc {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:11 devstack sudo[90697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a0c94bcf-b0ad-49bf-bcb1-d2a031b1aafc Apr 29 06:43:11 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:11 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8f3ec59b-b376-4d7c-9fb3-eb051edb6378 tempest-SnapshotsActionsTest-302093101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.5b126e67-8031-4745-a36b-4f3a8a14cacb 1G" returned: 0 in 0.851s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8f3ec59b-b376-4d7c-9fb3-eb051edb6378 tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.5b126e67-8031-4745-a36b-4f3a8a14cacb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:11 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.5b126e67-8031-4745-a36b-4f3a8a14cacb Apr 29 06:43:11 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:11 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5140a355-95ff-4d91-84b2-4d9438984a5b tempest-VolumesListTestJSON-962870651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a0c94bcf-b0ad-49bf-bcb1-d2a031b1aafc" returned: 0 in 0.757s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5140a355-95ff-4d91-84b2-4d9438984a5b tempest-VolumesListTestJSON-962870651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a0c94bcf-b0ad-49bf-bcb1-d2a031b1aafc {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:11 devstack sudo[90706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a0c94bcf-b0ad-49bf-bcb1-d2a031b1aafc Apr 29 06:43:11 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:11 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8f3ec59b-b376-4d7c-9fb3-eb051edb6378 tempest-SnapshotsActionsTest-302093101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.5b126e67-8031-4745-a36b-4f3a8a14cacb" returned: 0 in 0.682s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:11 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-8f3ec59b-b376-4d7c-9fb3-eb051edb6378 tempest-SnapshotsActionsTest-302093101 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.5b126e67-8031-4745-a36b-4f3a8a14cacb is being set with open permissions: ugo+rw Apr 29 06:43:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8f3ec59b-b376-4d7c-9fb3-eb051edb6378 tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.5b126e67-8031-4745-a36b-4f3a8a14cacb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:11 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.5b126e67-8031-4745-a36b-4f3a8a14cacb Apr 29 06:43:11 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:12 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5140a355-95ff-4d91-84b2-4d9438984a5b tempest-VolumesListTestJSON-962870651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a0c94bcf-b0ad-49bf-bcb1-d2a031b1aafc" returned: 0 in 0.620s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:12 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5140a355-95ff-4d91-84b2-4d9438984a5b tempest-VolumesListTestJSON-962870651 None] Lock "cinder-quobyte-a0c94bcf-b0ad-49bf-bcb1-d2a031b1aafc" released by "delete_volume" :: held 1.421s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:12 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-5140a355-95ff-4d91-84b2-4d9438984a5b tempest-VolumesListTestJSON-962870651 None] Created reservations ['fd85e0b5-5711-42b1-b560-c5cd8b3c519c', '2f29187b-558a-480a-90a4-954221b772fb', 'd5ae647d-9d5f-48bb-ab93-50c75620eb49', '0a86181b-cfb3-4c32-a86d-aabfc775dacb'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:43:12 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8f3ec59b-b376-4d7c-9fb3-eb051edb6378 tempest-SnapshotsActionsTest-302093101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.5b126e67-8031-4745-a36b-4f3a8a14cacb" returned: 0 in 0.622s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5140a355-95ff-4d91-84b2-4d9438984a5b tempest-VolumesListTestJSON-962870651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5140a355-95ff-4d91-84b2-4d9438984a5b tempest-VolumesListTestJSON-962870651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:12 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5140a355-95ff-4d91-84b2-4d9438984a5b tempest-VolumesListTestJSON-962870651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:43:12 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5140a355-95ff-4d91-84b2-4d9438984a5b tempest-VolumesListTestJSON-962870651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:43:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5140a355-95ff-4d91-84b2-4d9438984a5b tempest-VolumesListTestJSON-962870651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5140a355-95ff-4d91-84b2-4d9438984a5b tempest-VolumesListTestJSON-962870651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:12 devstack sudo[90714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:43:12 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8f3ec59b-b376-4d7c-9fb3-eb051edb6378 tempest-SnapshotsActionsTest-302093101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-705424be-3f29-4d6f-a026-31289da14888 tempest-GroupSnapshotsV319Test-1468295452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.832s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:12 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-705424be-3f29-4d6f-a026-31289da14888 tempest-GroupSnapshotsV319Test-1468295452 None] Creating offline snapshot e475756e-c1c7-4ab5-b6fe-b4325ac69b30 of volume 7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:43:12 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-8f3ec59b-b376-4d7c-9fb3-eb051edb6378 tempest-SnapshotsActionsTest-302093101 None] Create snapshot completed successfully Apr 29 06:43:12 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[59074e24-00ae-43c5-b364-a1478ea72007]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:43:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-705424be-3f29-4d6f-a026-31289da14888 tempest-GroupSnapshotsV319Test-1468295452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:12 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d Apr 29 06:43:12 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:12 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f63ac2fe-c682-4457-926b-f575d6da3930 tempest-SnapshotsActionsTest-953700288 None] Acquiring lock "cinder-5b126e67-8031-4745-a36b-4f3a8a14cacb-delete_snapshot" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:12 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f63ac2fe-c682-4457-926b-f575d6da3930 tempest-SnapshotsActionsTest-953700288 None] Lock "cinder-5b126e67-8031-4745-a36b-4f3a8a14cacb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:12 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f63ac2fe-c682-4457-926b-f575d6da3930 tempest-SnapshotsActionsTest-953700288 None] Acquiring lock "cinder-quobyte-b6627eec-d988-4f51-90cb-26ebcc610473" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:12 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f63ac2fe-c682-4457-926b-f575d6da3930 tempest-SnapshotsActionsTest-953700288 None] Lock "cinder-quobyte-b6627eec-d988-4f51-90cb-26ebcc610473" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:12 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f63ac2fe-c682-4457-926b-f575d6da3930 tempest-SnapshotsActionsTest-953700288 None] Acquiring lock "cinder-quobyte-5b126e67-8031-4745-a36b-4f3a8a14cacb" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:12 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f63ac2fe-c682-4457-926b-f575d6da3930 tempest-SnapshotsActionsTest-953700288 None] Lock "cinder-quobyte-5b126e67-8031-4745-a36b-4f3a8a14cacb" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:12 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-f63ac2fe-c682-4457-926b-f575d6da3930 tempest-SnapshotsActionsTest-953700288 None] Deleting offline snapshot 5b126e67-8031-4745-a36b-4f3a8a14cacb of volume b6627eec-d988-4f51-90cb-26ebcc610473 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:43:12 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-f63ac2fe-c682-4457-926b-f575d6da3930 tempest-SnapshotsActionsTest-953700288 None] snapshot_file for this snap is: volume-b6627eec-d988-4f51-90cb-26ebcc610473.5b126e67-8031-4745-a36b-4f3a8a14cacb {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:43:12 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a75be7d-1546-4f5b-8090-350c3608643c]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:43:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f63ac2fe-c682-4457-926b-f575d6da3930 tempest-SnapshotsActionsTest-953700288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.5b126e67-8031-4745-a36b-4f3a8a14cacb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:13 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.5b126e67-8031-4745-a36b-4f3a8a14cacb Apr 29 06:43:13 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:13 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:13 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-78ef2a54-85c2-453a-b1d0-c88ece8716ab tempest-VolumesListTestJSON-962870651 None] Acquiring lock "cinder-4224bbbb-37bb-453b-b0eb-a275badec5fc-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5140a355-95ff-4d91-84b2-4d9438984a5b tempest-VolumesListTestJSON-962870651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.730s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:13 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-5140a355-95ff-4d91-84b2-4d9438984a5b tempest-VolumesListTestJSON-962870651 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:43:13 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-5140a355-95ff-4d91-84b2-4d9438984a5b tempest-VolumesListTestJSON-962870651 None] Deleted volume successfully. Apr 29 06:43:13 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-78ef2a54-85c2-453a-b1d0-c88ece8716ab tempest-VolumesListTestJSON-962870651 None] Lock "cinder-4224bbbb-37bb-453b-b0eb-a275badec5fc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:13 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5140a355-95ff-4d91-84b2-4d9438984a5b tempest-VolumesListTestJSON-962870651 None] Lock "cinder-a0c94bcf-b0ad-49bf-bcb1-d2a031b1aafc-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:13 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-78ef2a54-85c2-453a-b1d0-c88ece8716ab tempest-VolumesListTestJSON-962870651 None] Acquiring lock "cinder-quobyte-4224bbbb-37bb-453b-b0eb-a275badec5fc" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:13 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-78ef2a54-85c2-453a-b1d0-c88ece8716ab tempest-VolumesListTestJSON-962870651 None] Lock "cinder-quobyte-4224bbbb-37bb-453b-b0eb-a275badec5fc" acquired by "delete_volume" :: waited 0.021s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:13 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cfa895-4b03-4646-a5a8-b45073bdbdaf]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:43:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-78ef2a54-85c2-453a-b1d0-c88ece8716ab tempest-VolumesListTestJSON-962870651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-4224bbbb-37bb-453b-b0eb-a275badec5fc {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:13 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-705424be-3f29-4d6f-a026-31289da14888 tempest-GroupSnapshotsV319Test-1468295452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d" returned: 0 in 0.851s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-705424be-3f29-4d6f-a026-31289da14888 tempest-GroupSnapshotsV319Test-1468295452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d.e475756e-c1c7-4ab5-b6fe-b4325ac69b30 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:13 devstack sudo[90724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-4224bbbb-37bb-453b-b0eb-a275badec5fc Apr 29 06:43:13 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:13 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d.e475756e-c1c7-4ab5-b6fe-b4325ac69b30 1G Apr 29 06:43:13 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:13 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f63ac2fe-c682-4457-926b-f575d6da3930 tempest-SnapshotsActionsTest-953700288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.5b126e67-8031-4745-a36b-4f3a8a14cacb" returned: 0 in 0.865s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:13 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-f63ac2fe-c682-4457-926b-f575d6da3930 tempest-SnapshotsActionsTest-953700288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6627eec-d988-4f51-90cb-26ebcc610473(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:43:13 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5dc6b8-5d56-43fb-a013-37ca2cc82437]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:43:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f63ac2fe-c682-4457-926b-f575d6da3930 tempest-SnapshotsActionsTest-953700288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:13 devstack sudo[90731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 Apr 29 06:43:13 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:14 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-78ef2a54-85c2-453a-b1d0-c88ece8716ab tempest-VolumesListTestJSON-962870651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-4224bbbb-37bb-453b-b0eb-a275badec5fc" returned: 0 in 0.841s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-78ef2a54-85c2-453a-b1d0-c88ece8716ab tempest-VolumesListTestJSON-962870651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-4224bbbb-37bb-453b-b0eb-a275badec5fc {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:14 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-4224bbbb-37bb-453b-b0eb-a275badec5fc Apr 29 06:43:14 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:14 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-705424be-3f29-4d6f-a026-31289da14888 tempest-GroupSnapshotsV319Test-1468295452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d.e475756e-c1c7-4ab5-b6fe-b4325ac69b30 1G" returned: 0 in 0.836s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-705424be-3f29-4d6f-a026-31289da14888 tempest-GroupSnapshotsV319Test-1468295452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d.e475756e-c1c7-4ab5-b6fe-b4325ac69b30 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:14 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d.e475756e-c1c7-4ab5-b6fe-b4325ac69b30 Apr 29 06:43:14 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:14 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f63ac2fe-c682-4457-926b-f575d6da3930 tempest-SnapshotsActionsTest-953700288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896" returned: 0 in 0.777s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:14 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-f63ac2fe-c682-4457-926b-f575d6da3930 tempest-SnapshotsActionsTest-953700288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6627eec-d988-4f51-90cb-26ebcc610473(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:43:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f63ac2fe-c682-4457-926b-f575d6da3930 tempest-SnapshotsActionsTest-953700288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.5b126e67-8031-4745-a36b-4f3a8a14cacb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:14 devstack sudo[90746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.5b126e67-8031-4745-a36b-4f3a8a14cacb Apr 29 06:43:14 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:14 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-78ef2a54-85c2-453a-b1d0-c88ece8716ab tempest-VolumesListTestJSON-962870651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-4224bbbb-37bb-453b-b0eb-a275badec5fc" returned: 0 in 0.671s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:14 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-78ef2a54-85c2-453a-b1d0-c88ece8716ab tempest-VolumesListTestJSON-962870651 None] Lock "cinder-quobyte-4224bbbb-37bb-453b-b0eb-a275badec5fc" released by "delete_volume" :: held 1.564s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:14 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-78ef2a54-85c2-453a-b1d0-c88ece8716ab tempest-VolumesListTestJSON-962870651 None] Created reservations ['7c993e3e-4827-4ff6-91e4-52938b7a0247', '7fce6a05-10ba-4cb6-ab2e-301553115766', '3ded0bf0-9d7a-4ca2-9c17-6bbd03104d67', 'ee1e38ff-fb86-4c84-8ccf-2035c1822d8a'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:43:15 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-705424be-3f29-4d6f-a026-31289da14888 tempest-GroupSnapshotsV319Test-1468295452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d.e475756e-c1c7-4ab5-b6fe-b4325ac69b30" returned: 0 in 0.680s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:15 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-705424be-3f29-4d6f-a026-31289da14888 tempest-GroupSnapshotsV319Test-1468295452 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d.e475756e-c1c7-4ab5-b6fe-b4325ac69b30 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 06:43:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-705424be-3f29-4d6f-a026-31289da14888 tempest-GroupSnapshotsV319Test-1468295452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d.e475756e-c1c7-4ab5-b6fe-b4325ac69b30 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:15 devstack sudo[90752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d.e475756e-c1c7-4ab5-b6fe-b4325ac69b30 Apr 29 06:43:15 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-78ef2a54-85c2-453a-b1d0-c88ece8716ab tempest-VolumesListTestJSON-962870651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-78ef2a54-85c2-453a-b1d0-c88ece8716ab tempest-VolumesListTestJSON-962870651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:15 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-78ef2a54-85c2-453a-b1d0-c88ece8716ab tempest-VolumesListTestJSON-962870651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:43:15 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-78ef2a54-85c2-453a-b1d0-c88ece8716ab tempest-VolumesListTestJSON-962870651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:43:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-78ef2a54-85c2-453a-b1d0-c88ece8716ab tempest-VolumesListTestJSON-962870651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-78ef2a54-85c2-453a-b1d0-c88ece8716ab tempest-VolumesListTestJSON-962870651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:15 devstack sudo[90754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:43:15 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:15 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f63ac2fe-c682-4457-926b-f575d6da3930 tempest-SnapshotsActionsTest-953700288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.5b126e67-8031-4745-a36b-4f3a8a14cacb" returned: 0 in 0.764s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f63ac2fe-c682-4457-926b-f575d6da3930 tempest-SnapshotsActionsTest-953700288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.5b126e67-8031-4745-a36b-4f3a8a14cacb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:15 devstack sudo[90759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.5b126e67-8031-4745-a36b-4f3a8a14cacb Apr 29 06:43:15 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:15 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f7faa5b7-f003-48a1-82f5-3bdd7b082ea4 tempest-VolumesListTestJSON-962870651 None] Acquiring lock "cinder-154626d3-ecf8-4b1b-8ec3-49edb8332f9f-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:15 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f7faa5b7-f003-48a1-82f5-3bdd7b082ea4 tempest-VolumesListTestJSON-962870651 None] Lock "cinder-154626d3-ecf8-4b1b-8ec3-49edb8332f9f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:15 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:SELECT=167,cinder:UPDATE=202,cinder:DELETE=17,cinder:INSERT=52 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:43:15 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f7faa5b7-f003-48a1-82f5-3bdd7b082ea4 tempest-VolumesListTestJSON-962870651 None] Acquiring lock "cinder-quobyte-154626d3-ecf8-4b1b-8ec3-49edb8332f9f" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:15 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-705424be-3f29-4d6f-a026-31289da14888 tempest-GroupSnapshotsV319Test-1468295452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d.e475756e-c1c7-4ab5-b6fe-b4325ac69b30" returned: 0 in 0.695s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:15 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f7faa5b7-f003-48a1-82f5-3bdd7b082ea4 tempest-VolumesListTestJSON-962870651 None] Lock "cinder-quobyte-154626d3-ecf8-4b1b-8ec3-49edb8332f9f" acquired by "delete_volume" :: waited 0.033s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-705424be-3f29-4d6f-a026-31289da14888 tempest-GroupSnapshotsV319Test-1468295452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:15 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbf5e6e-afc3-4922-964f-e08af6559acd]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:43:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f7faa5b7-f003-48a1-82f5-3bdd7b082ea4 tempest-VolumesListTestJSON-962870651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-154626d3-ecf8-4b1b-8ec3-49edb8332f9f {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:15 devstack sudo[90763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d.info Apr 29 06:43:15 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:15 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-78ef2a54-85c2-453a-b1d0-c88ece8716ab tempest-VolumesListTestJSON-962870651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.710s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:15 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-78ef2a54-85c2-453a-b1d0-c88ece8716ab tempest-VolumesListTestJSON-962870651 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:43:15 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-78ef2a54-85c2-453a-b1d0-c88ece8716ab tempest-VolumesListTestJSON-962870651 None] Deleted volume successfully. Apr 29 06:43:15 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-78ef2a54-85c2-453a-b1d0-c88ece8716ab tempest-VolumesListTestJSON-962870651 None] Lock "cinder-4224bbbb-37bb-453b-b0eb-a275badec5fc-delete_volume" released by "delete_volume" :: held 2.535s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:15 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-154626d3-ecf8-4b1b-8ec3-49edb8332f9f Apr 29 06:43:15 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:16 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f63ac2fe-c682-4457-926b-f575d6da3930 tempest-SnapshotsActionsTest-953700288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.5b126e67-8031-4745-a36b-4f3a8a14cacb" returned: 0 in 0.695s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:16 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f63ac2fe-c682-4457-926b-f575d6da3930 tempest-SnapshotsActionsTest-953700288 None] Lock "cinder-quobyte-5b126e67-8031-4745-a36b-4f3a8a14cacb" released by "_delete_snapshot" :: held 3.209s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:16 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f63ac2fe-c682-4457-926b-f575d6da3930 tempest-SnapshotsActionsTest-953700288 None] Lock "cinder-quobyte-b6627eec-d988-4f51-90cb-26ebcc610473" released by "delete_snapshot" :: held 3.239s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:16 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-f63ac2fe-c682-4457-926b-f575d6da3930 tempest-SnapshotsActionsTest-953700288 None] Created reservations ['49c768ce-e207-42e2-a31e-b2033cae15fe', '9b760b85-07ba-4c62-89a3-05bfccf4ada5', '253fb239-6491-42ec-8413-33c073b27a03', 'b0d17048-d91e-4f0f-bc33-f017d9d997c2'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:43:16 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-f63ac2fe-c682-4457-926b-f575d6da3930 tempest-SnapshotsActionsTest-953700288 None] Delete snapshot completed successfully. Apr 29 06:43:16 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f63ac2fe-c682-4457-926b-f575d6da3930 tempest-SnapshotsActionsTest-953700288 None] Lock "cinder-5b126e67-8031-4745-a36b-4f3a8a14cacb-delete_snapshot" released by "delete_snapshot" :: held 3.392s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:16 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-705424be-3f29-4d6f-a026-31289da14888 tempest-GroupSnapshotsV319Test-1468295452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d.info" returned: 0 in 0.654s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:16 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-705424be-3f29-4d6f-a026-31289da14888 tempest-GroupSnapshotsV319Test-1468295452 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 06:43:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-705424be-3f29-4d6f-a026-31289da14888 tempest-GroupSnapshotsV319Test-1468295452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:16 devstack sudo[90772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d.info Apr 29 06:43:16 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:16 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f7faa5b7-f003-48a1-82f5-3bdd7b082ea4 tempest-VolumesListTestJSON-962870651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-154626d3-ecf8-4b1b-8ec3-49edb8332f9f" returned: 0 in 0.802s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f7faa5b7-f003-48a1-82f5-3bdd7b082ea4 tempest-VolumesListTestJSON-962870651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-154626d3-ecf8-4b1b-8ec3-49edb8332f9f {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:16 devstack sudo[90776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-154626d3-ecf8-4b1b-8ec3-49edb8332f9f Apr 29 06:43:16 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:17 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-705424be-3f29-4d6f-a026-31289da14888 tempest-GroupSnapshotsV319Test-1468295452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d.info" returned: 0 in 0.673s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-705424be-3f29-4d6f-a026-31289da14888 tempest-GroupSnapshotsV319Test-1468295452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.514s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:17 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:UPDATE=216,cinder:SELECT=187,cinder:INSERT=63,cinder:DELETE=10 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:43:17 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-705424be-3f29-4d6f-a026-31289da14888 tempest-GroupSnapshotsV319Test-1468295452 None] group_snapshot 00ff15bf-2366-488f-bf39-1aa2d4dcb934: created successfully Apr 29 06:43:17 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f7faa5b7-f003-48a1-82f5-3bdd7b082ea4 tempest-VolumesListTestJSON-962870651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-154626d3-ecf8-4b1b-8ec3-49edb8332f9f" returned: 0 in 0.641s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:17 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f7faa5b7-f003-48a1-82f5-3bdd7b082ea4 tempest-VolumesListTestJSON-962870651 None] Lock "cinder-quobyte-154626d3-ecf8-4b1b-8ec3-49edb8332f9f" released by "delete_volume" :: held 1.506s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:17 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-f7faa5b7-f003-48a1-82f5-3bdd7b082ea4 tempest-VolumesListTestJSON-962870651 None] Created reservations ['76c4c4ab-ba08-441e-9dac-b5c9d794ab48', 'eba11989-6c9c-4a80-abd2-89bc6d5b2429', 'c49381bd-dd55-4251-a63e-e1c3f23b9487', 'feeb73a0-c3d3-4f96-a0be-f86629cea6c7'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:43:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f7faa5b7-f003-48a1-82f5-3bdd7b082ea4 tempest-VolumesListTestJSON-962870651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f7faa5b7-f003-48a1-82f5-3bdd7b082ea4 tempest-VolumesListTestJSON-962870651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:17 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f7faa5b7-f003-48a1-82f5-3bdd7b082ea4 tempest-VolumesListTestJSON-962870651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:43:17 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f7faa5b7-f003-48a1-82f5-3bdd7b082ea4 tempest-VolumesListTestJSON-962870651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:43:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f7faa5b7-f003-48a1-82f5-3bdd7b082ea4 tempest-VolumesListTestJSON-962870651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f7faa5b7-f003-48a1-82f5-3bdd7b082ea4 tempest-VolumesListTestJSON-962870651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:17 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:43:17 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:17 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-043bd3a6-fbd2-4542-90af-0cc38ec47576 tempest-SnapshotsActionsTest-302093101 None] Acquiring lock "cinder-cbe39def-5a1c-4ab5-ab64-ab85abc80896-delete_snapshot" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:17 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-043bd3a6-fbd2-4542-90af-0cc38ec47576 tempest-SnapshotsActionsTest-302093101 None] Lock "cinder-cbe39def-5a1c-4ab5-ab64-ab85abc80896-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:17 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-043bd3a6-fbd2-4542-90af-0cc38ec47576 tempest-SnapshotsActionsTest-302093101 None] Acquiring lock "cinder-quobyte-b6627eec-d988-4f51-90cb-26ebcc610473" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:17 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-043bd3a6-fbd2-4542-90af-0cc38ec47576 tempest-SnapshotsActionsTest-302093101 None] Lock "cinder-quobyte-b6627eec-d988-4f51-90cb-26ebcc610473" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:17 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-043bd3a6-fbd2-4542-90af-0cc38ec47576 tempest-SnapshotsActionsTest-302093101 None] Acquiring lock "cinder-quobyte-cbe39def-5a1c-4ab5-ab64-ab85abc80896" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:17 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-043bd3a6-fbd2-4542-90af-0cc38ec47576 tempest-SnapshotsActionsTest-302093101 None] Lock "cinder-quobyte-cbe39def-5a1c-4ab5-ab64-ab85abc80896" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:17 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-043bd3a6-fbd2-4542-90af-0cc38ec47576 tempest-SnapshotsActionsTest-302093101 None] Deleting offline snapshot cbe39def-5a1c-4ab5-ab64-ab85abc80896 of volume b6627eec-d988-4f51-90cb-26ebcc610473 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:43:17 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-043bd3a6-fbd2-4542-90af-0cc38ec47576 tempest-SnapshotsActionsTest-302093101 None] snapshot_file for this snap is: volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:43:17 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba0429a-ed5d-4e6b-9d0d-d2708ff3a529]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:43:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-043bd3a6-fbd2-4542-90af-0cc38ec47576 tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:17 devstack sudo[90783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 Apr 29 06:43:17 devstack sudo[90783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:17 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f7faa5b7-f003-48a1-82f5-3bdd7b082ea4 tempest-VolumesListTestJSON-962870651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.625s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:17 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-f7faa5b7-f003-48a1-82f5-3bdd7b082ea4 tempest-VolumesListTestJSON-962870651 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:43:17 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-f7faa5b7-f003-48a1-82f5-3bdd7b082ea4 tempest-VolumesListTestJSON-962870651 None] Deleted volume successfully. Apr 29 06:43:18 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f7faa5b7-f003-48a1-82f5-3bdd7b082ea4 tempest-VolumesListTestJSON-962870651 None] Lock "cinder-154626d3-ecf8-4b1b-8ec3-49edb8332f9f-delete_volume" released by "delete_volume" :: held 2.366s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:18 devstack sudo[90783]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-043bd3a6-fbd2-4542-90af-0cc38ec47576 tempest-SnapshotsActionsTest-302093101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896" returned: 0 in 0.791s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-043bd3a6-fbd2-4542-90af-0cc38ec47576 tempest-SnapshotsActionsTest-302093101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6627eec-d988-4f51-90cb-26ebcc610473(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:43:18 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[889b907b-980a-4113-a1ec-a13bfc4b9e6b]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:43:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-043bd3a6-fbd2-4542-90af-0cc38ec47576 tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:18 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-3fd5773e-1bed-4090-9037-aeec9c7d6d48 tempest-GroupSnapshotsV319Test-1468295452 None] group_snapshot 00ff15bf-2366-488f-bf39-1aa2d4dcb934: deleting Apr 29 06:43:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3fd5773e-1bed-4090-9037-aeec9c7d6d48 tempest-GroupSnapshotsV319Test-1468295452 None] group_snapshot 00ff15bf-2366-488f-bf39-1aa2d4dcb934: deleting {{(pid=84195) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 06:43:18 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473 Apr 29 06:43:18 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:18 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3fd5773e-1bed-4090-9037-aeec9c7d6d48 tempest-GroupSnapshotsV319Test-1468295452 None] Acquiring lock "cinder-quobyte-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:18 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3fd5773e-1bed-4090-9037-aeec9c7d6d48 tempest-GroupSnapshotsV319Test-1468295452 None] Lock "cinder-quobyte-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:18 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3fd5773e-1bed-4090-9037-aeec9c7d6d48 tempest-GroupSnapshotsV319Test-1468295452 None] Acquiring lock "cinder-quobyte-e475756e-c1c7-4ab5-b6fe-b4325ac69b30" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:18 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3fd5773e-1bed-4090-9037-aeec9c7d6d48 tempest-GroupSnapshotsV319Test-1468295452 None] Lock "cinder-quobyte-e475756e-c1c7-4ab5-b6fe-b4325ac69b30" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-3fd5773e-1bed-4090-9037-aeec9c7d6d48 tempest-GroupSnapshotsV319Test-1468295452 None] Deleting offline snapshot e475756e-c1c7-4ab5-b6fe-b4325ac69b30 of volume 7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:43:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-3fd5773e-1bed-4090-9037-aeec9c7d6d48 tempest-GroupSnapshotsV319Test-1468295452 None] snapshot_file for this snap is: volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d.e475756e-c1c7-4ab5-b6fe-b4325ac69b30 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:43:18 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[392d724a-6832-4115-a023-d49c88a102df]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:43:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3fd5773e-1bed-4090-9037-aeec9c7d6d48 tempest-GroupSnapshotsV319Test-1468295452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d.e475756e-c1c7-4ab5-b6fe-b4325ac69b30 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:18 devstack sudo[90791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d.e475756e-c1c7-4ab5-b6fe-b4325ac69b30 Apr 29 06:43:18 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:19 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-043bd3a6-fbd2-4542-90af-0cc38ec47576 tempest-SnapshotsActionsTest-302093101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473" returned: 0 in 0.861s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-043bd3a6-fbd2-4542-90af-0cc38ec47576 tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:19 devstack sudo[90797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 Apr 29 06:43:19 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:19 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3fd5773e-1bed-4090-9037-aeec9c7d6d48 tempest-GroupSnapshotsV319Test-1468295452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d.e475756e-c1c7-4ab5-b6fe-b4325ac69b30" returned: 0 in 0.851s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:19 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-3fd5773e-1bed-4090-9037-aeec9c7d6d48 tempest-GroupSnapshotsV319Test-1468295452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:43:19 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b78d0d2-3747-462a-8ce3-a27252c25606]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:43:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3fd5773e-1bed-4090-9037-aeec9c7d6d48 tempest-GroupSnapshotsV319Test-1468295452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:19 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d Apr 29 06:43:19 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:20 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-043bd3a6-fbd2-4542-90af-0cc38ec47576 tempest-SnapshotsActionsTest-302093101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896" returned: 0 in 0.762s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-043bd3a6-fbd2-4542-90af-0cc38ec47576 tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:20 devstack sudo[90808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896 Apr 29 06:43:20 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:20 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3fd5773e-1bed-4090-9037-aeec9c7d6d48 tempest-GroupSnapshotsV319Test-1468295452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d" returned: 0 in 0.741s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3fd5773e-1bed-4090-9037-aeec9c7d6d48 tempest-GroupSnapshotsV319Test-1468295452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d.e475756e-c1c7-4ab5-b6fe-b4325ac69b30 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:20 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d.e475756e-c1c7-4ab5-b6fe-b4325ac69b30 Apr 29 06:43:20 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:20 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-043bd3a6-fbd2-4542-90af-0cc38ec47576 tempest-SnapshotsActionsTest-302093101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473.cbe39def-5a1c-4ab5-ab64-ab85abc80896" returned: 0 in 0.643s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-043bd3a6-fbd2-4542-90af-0cc38ec47576 tempest-SnapshotsActionsTest-302093101 None] Lock "cinder-quobyte-cbe39def-5a1c-4ab5-ab64-ab85abc80896" released by "_delete_snapshot" :: held 3.181s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-043bd3a6-fbd2-4542-90af-0cc38ec47576 tempest-SnapshotsActionsTest-302093101 None] Lock "cinder-quobyte-b6627eec-d988-4f51-90cb-26ebcc610473" released by "delete_snapshot" :: held 3.209s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-043bd3a6-fbd2-4542-90af-0cc38ec47576 tempest-SnapshotsActionsTest-302093101 None] Created reservations ['65e20341-06f7-490c-965b-94951465462a', 'b3655313-12a6-4cce-9f13-f9f3a118611c', '2fc08ba4-aed0-4fda-97cd-de34918f2913', '4872f800-1083-4a5c-95e3-f6732d32b6c5'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Flow 'volume_create_manager' (5f902b0f-2fdd-443d-9934-a659175f3d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01e6f599-4b76-4d8b-8a01-efcff5da8788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01e6f599-4b76-4d8b-8a01-efcff5da8788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-911811018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d64c7e-2ef4-413a-adfd-14bcd4daa945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0eb44672b2445c79870a5b6600b2309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:43:21Z,use_quota=True,user_id='261d9f329bc34bfba4039b8122c66173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebdfa1c2-25b6-4717-b2ee-a2b51c8318c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebdfa1c2-25b6-4717-b2ee-a2b51c8318c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5859777a-228a-4cc7-8733-c369b014af5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5859777a-228a-4cc7-8733-c369b014af5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15d64c7e-2ef4-413a-adfd-14bcd4daa945', 'volume_name': 'volume-15d64c7e-2ef4-413a-adfd-14bcd4daa945', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4efbd7fc-bd57-4308-ac90-79967eb769f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4efbd7fc-bd57-4308-ac90-79967eb769f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c2fa66-e9fa-4759-a007-3440774110c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:20 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Volume 15d64c7e-2ef4-413a-adfd-14bcd4daa945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15d64c7e-2ef4-413a-adfd-14bcd4daa945', 'volume_size': 1} Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-911811018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d64c7e-2ef4-413a-adfd-14bcd4daa945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0eb44672b2445c79870a5b6600b2309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:43:21Z,use_quota=True,user_id='261d9f329bc34bfba4039b8122c66173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Creating volume 15d64c7e-2ef4-413a-adfd-14bcd4daa945 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:43:20 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:43:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-15d64c7e-2ef4-413a-adfd-14bcd4daa945 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:21 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-043bd3a6-fbd2-4542-90af-0cc38ec47576 tempest-SnapshotsActionsTest-302093101 None] Delete snapshot completed successfully. Apr 29 06:43:21 devstack sudo[90819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-15d64c7e-2ef4-413a-adfd-14bcd4daa945 1073741824 Apr 29 06:43:21 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-043bd3a6-fbd2-4542-90af-0cc38ec47576 tempest-SnapshotsActionsTest-302093101 None] Lock "cinder-cbe39def-5a1c-4ab5-ab64-ab85abc80896-delete_snapshot" released by "delete_snapshot" :: held 3.502s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:21 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3fd5773e-1bed-4090-9037-aeec9c7d6d48 tempest-GroupSnapshotsV319Test-1468295452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d.e475756e-c1c7-4ab5-b6fe-b4325ac69b30" returned: 0 in 0.781s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3fd5773e-1bed-4090-9037-aeec9c7d6d48 tempest-GroupSnapshotsV319Test-1468295452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d.e475756e-c1c7-4ab5-b6fe-b4325ac69b30 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:21 devstack sudo[90821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d.e475756e-c1c7-4ab5-b6fe-b4325ac69b30 Apr 29 06:43:21 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:21 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3fd5773e-1bed-4090-9037-aeec9c7d6d48 tempest-GroupSnapshotsV319Test-1468295452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d.e475756e-c1c7-4ab5-b6fe-b4325ac69b30" returned: 0 in 0.595s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3fd5773e-1bed-4090-9037-aeec9c7d6d48 tempest-GroupSnapshotsV319Test-1468295452 None] Lock "cinder-quobyte-e475756e-c1c7-4ab5-b6fe-b4325ac69b30" released by "_delete_snapshot" :: held 3.137s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3fd5773e-1bed-4090-9037-aeec9c7d6d48 tempest-GroupSnapshotsV319Test-1468295452 None] Lock "cinder-quobyte-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d" released by "delete_snapshot" :: held 3.176s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:21 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-15d64c7e-2ef4-413a-adfd-14bcd4daa945 1073741824" returned: 0 in 0.819s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:21 devstack cinder-volume[84195]: WARNING cinder.quota [None req-3fd5773e-1bed-4090-9037-aeec9c7d6d48 tempest-GroupSnapshotsV319Test-1468295452 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-155636845 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-155636845, it is now deprecated. Please use the default quota class for default quota. Apr 29 06:43:21 devstack cinder-volume[84195]: WARNING cinder.quota [None req-3fd5773e-1bed-4090-9037-aeec9c7d6d48 tempest-GroupSnapshotsV319Test-1468295452 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-155636845 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-155636845, it is now deprecated. Please use the default quota class for default quota. Apr 29 06:43:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-15d64c7e-2ef4-413a-adfd-14bcd4daa945 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8de18351-7bb1-4edd-a291-9d87155238c9 tempest-SnapshotsActionsTest-302093101 None] Acquiring lock "cinder-b6627eec-d988-4f51-90cb-26ebcc610473-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:21 devstack sudo[90827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-15d64c7e-2ef4-413a-adfd-14bcd4daa945 Apr 29 06:43:21 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:21 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-3fd5773e-1bed-4090-9037-aeec9c7d6d48 tempest-GroupSnapshotsV319Test-1468295452 None] Created reservations ['4e0c19e4-ed2c-4eb9-b72d-8c81e6ee1bbe', 'bbe2ee92-f273-40ce-bbcc-b21f087ad5c9', '0d412d00-4daa-454b-afb2-e4df99f6cb93', 'b1b8aefe-ec9d-4831-a554-00846e600135'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:43:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8de18351-7bb1-4edd-a291-9d87155238c9 tempest-SnapshotsActionsTest-302093101 None] Lock "cinder-b6627eec-d988-4f51-90cb-26ebcc610473-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8de18351-7bb1-4edd-a291-9d87155238c9 tempest-SnapshotsActionsTest-302093101 None] Acquiring lock "cinder-quobyte-b6627eec-d988-4f51-90cb-26ebcc610473" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:22 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8de18351-7bb1-4edd-a291-9d87155238c9 tempest-SnapshotsActionsTest-302093101 None] Lock "cinder-quobyte-b6627eec-d988-4f51-90cb-26ebcc610473" acquired by "delete_volume" :: waited 0.025s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:22 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-3fd5773e-1bed-4090-9037-aeec9c7d6d48 tempest-GroupSnapshotsV319Test-1468295452 None] group_snapshot 00ff15bf-2366-488f-bf39-1aa2d4dcb934: deleted successfully Apr 29 06:43:22 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0a72db-76f3-4827-b852-fe20b4401f02]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:43:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8de18351-7bb1-4edd-a291-9d87155238c9 tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:22 devstack sudo[90829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473 Apr 29 06:43:22 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:22 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-15d64c7e-2ef4-413a-adfd-14bcd4daa945" returned: 0 in 0.637s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:43:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c2fa66-e9fa-4759-a007-3440774110c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15d64c7e-2ef4-413a-adfd-14bcd4daa945', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f9bca5d-7236-49aa-ac5c-d7fed21ca299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:22 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Volume volume-15d64c7e-2ef4-413a-adfd-14bcd4daa945 (15d64c7e-2ef4-413a-adfd-14bcd4daa945): created successfully Apr 29 06:43:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f9bca5d-7236-49aa-ac5c-d7fed21ca299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Flow 'volume_create_manager' (5f902b0f-2fdd-443d-9934-a659175f3d03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:43:22 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-57388ac3-4105-4f86-bd6b-46ad952c001c tempest-VolumesNegativeTest-705297189 None] Created volume successfully. Apr 29 06:43:22 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8de18351-7bb1-4edd-a291-9d87155238c9 tempest-SnapshotsActionsTest-302093101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473" returned: 0 in 0.722s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8de18351-7bb1-4edd-a291-9d87155238c9 tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:22 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473 Apr 29 06:43:22 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:23 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8d4a26f7-3d4b-4434-9efc-61f55793da69 tempest-GroupSnapshotsV319Test-1468295452 None] Acquiring lock "cinder-quobyte-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:23 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8d4a26f7-3d4b-4434-9efc-61f55793da69 tempest-GroupSnapshotsV319Test-1468295452 None] Lock "cinder-quobyte-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d" acquired by "delete_volume" :: waited 0.019s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:23 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f25d6a3-abaa-4115-84c7-1a29f0155ce4]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:43:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8d4a26f7-3d4b-4434-9efc-61f55793da69 tempest-GroupSnapshotsV319Test-1468295452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:23 devstack sudo[90837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d Apr 29 06:43:23 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:23 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8de18351-7bb1-4edd-a291-9d87155238c9 tempest-SnapshotsActionsTest-302093101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b6627eec-d988-4f51-90cb-26ebcc610473" returned: 0 in 0.643s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:23 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8de18351-7bb1-4edd-a291-9d87155238c9 tempest-SnapshotsActionsTest-302093101 None] Lock "cinder-quobyte-b6627eec-d988-4f51-90cb-26ebcc610473" released by "delete_volume" :: held 1.446s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:23 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-8de18351-7bb1-4edd-a291-9d87155238c9 tempest-SnapshotsActionsTest-302093101 None] Created reservations ['8097df4a-4170-47be-8ef6-3f3c9eb36cbc', '34c57322-5366-45b4-9b89-328c4d9ec697', 'aefe2a72-bcc5-4001-97d2-376b59dbebaf', '4d311d5b-0e08-409a-ba22-b90d18368163'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:43:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8de18351-7bb1-4edd-a291-9d87155238c9 tempest-SnapshotsActionsTest-302093101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8de18351-7bb1-4edd-a291-9d87155238c9 tempest-SnapshotsActionsTest-302093101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:23 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8de18351-7bb1-4edd-a291-9d87155238c9 tempest-SnapshotsActionsTest-302093101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:43:23 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8de18351-7bb1-4edd-a291-9d87155238c9 tempest-SnapshotsActionsTest-302093101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:43:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8de18351-7bb1-4edd-a291-9d87155238c9 tempest-SnapshotsActionsTest-302093101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8de18351-7bb1-4edd-a291-9d87155238c9 tempest-SnapshotsActionsTest-302093101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:23 devstack sudo[90862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:43:23 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:24 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8d4a26f7-3d4b-4434-9efc-61f55793da69 tempest-GroupSnapshotsV319Test-1468295452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d" returned: 0 in 0.959s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8d4a26f7-3d4b-4434-9efc-61f55793da69 tempest-GroupSnapshotsV319Test-1468295452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:24 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d Apr 29 06:43:24 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:24 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8de18351-7bb1-4edd-a291-9d87155238c9 tempest-SnapshotsActionsTest-302093101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.765s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:24 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-8de18351-7bb1-4edd-a291-9d87155238c9 tempest-SnapshotsActionsTest-302093101 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:43:24 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-8de18351-7bb1-4edd-a291-9d87155238c9 tempest-SnapshotsActionsTest-302093101 None] Deleted volume successfully. Apr 29 06:43:24 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8de18351-7bb1-4edd-a291-9d87155238c9 tempest-SnapshotsActionsTest-302093101 None] Lock "cinder-b6627eec-d988-4f51-90cb-26ebcc610473-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:24 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8d4a26f7-3d4b-4434-9efc-61f55793da69 tempest-GroupSnapshotsV319Test-1468295452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d" returned: 0 in 0.777s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:25 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8d4a26f7-3d4b-4434-9efc-61f55793da69 tempest-GroupSnapshotsV319Test-1468295452 None] Lock "cinder-quobyte-7c90a72b-d6f9-4a2c-9f92-27d645a7ab5d" released by "delete_volume" :: held 1.818s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:25 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-8d4a26f7-3d4b-4434-9efc-61f55793da69 tempest-GroupSnapshotsV319Test-1468295452 None] Created reservations ['85c8d6c8-5bbb-4db6-af13-d3ecaf80092c'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:43:25 devstack cinder-volume[84195]: WARNING cinder.quota [None req-8d4a26f7-3d4b-4434-9efc-61f55793da69 tempest-GroupSnapshotsV319Test-1468295452 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-155636845 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-155636845, it is now deprecated. Please use the default quota class for default quota. Apr 29 06:43:25 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-8d4a26f7-3d4b-4434-9efc-61f55793da69 tempest-GroupSnapshotsV319Test-1468295452 None] Created reservations ['48d352b7-d53d-471a-b20d-8a529e3f9d87', '5500478f-75ca-49a6-97ba-cfca1c2dddfd', '57504e7d-f3a4-4e59-9a5c-7f417fd6ea87', '0b492f10-297e-46ce-8fb2-400e0dc413d3'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:43:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8d4a26f7-3d4b-4434-9efc-61f55793da69 tempest-GroupSnapshotsV319Test-1468295452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8d4a26f7-3d4b-4434-9efc-61f55793da69 tempest-GroupSnapshotsV319Test-1468295452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:25 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8d4a26f7-3d4b-4434-9efc-61f55793da69 tempest-GroupSnapshotsV319Test-1468295452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:43:25 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8d4a26f7-3d4b-4434-9efc-61f55793da69 tempest-GroupSnapshotsV319Test-1468295452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:43:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8d4a26f7-3d4b-4434-9efc-61f55793da69 tempest-GroupSnapshotsV319Test-1468295452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8d4a26f7-3d4b-4434-9efc-61f55793da69 tempest-GroupSnapshotsV319Test-1468295452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:25 devstack sudo[90889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:43:25 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:25 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8d4a26f7-3d4b-4434-9efc-61f55793da69 tempest-GroupSnapshotsV319Test-1468295452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.691s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:25 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-8d4a26f7-3d4b-4434-9efc-61f55793da69 tempest-GroupSnapshotsV319Test-1468295452 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:43:25 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-8d4a26f7-3d4b-4434-9efc-61f55793da69 tempest-GroupSnapshotsV319Test-1468295452 None] Delete group completed successfully. Apr 29 06:43:31 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-da7e0b07-a0db-4498-9bd8-ecc6d6e8e458 tempest-GroupsTest-37871535 None] Group tempest-Group1-1309749665: creating Apr 29 06:43:31 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-da7e0b07-a0db-4498-9bd8-ecc6d6e8e458 tempest-GroupsTest-37871535 None] Group tempest-Group1-1309749665: created successfully Apr 29 06:43:31 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-da7e0b07-a0db-4498-9bd8-ecc6d6e8e458 tempest-GroupsTest-37871535 None] Create group completed successfully. Apr 29 06:43:32 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-8111df9f-1763-4178-92b6-e7cd05e63404 tempest-GroupsTest-37871535 None] Group tempest-Group2-1913266475: creating Apr 29 06:43:32 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-8111df9f-1763-4178-92b6-e7cd05e63404 tempest-GroupsTest-37871535 None] Group tempest-Group2-1913266475: created successfully Apr 29 06:43:32 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-8111df9f-1763-4178-92b6-e7cd05e63404 tempest-GroupsTest-37871535 None] Create group completed successfully. Apr 29 06:43:34 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:43:34 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Flow 'volume_create_manager' (a658c10c-96d5-40a8-a12b-e81ad06bb524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:43:34 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb961d2-a5ba-4ca3-9b18-bbdf40597ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:34 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb961d2-a5ba-4ca3-9b18-bbdf40597ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-347651134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b340d0e1-0030-49e4-854d-783956de1aa5,host='devstack@QuobyteHD#QuobyteHD',id=fb81c3d1-1f10-4d59-9737-94028dc1b089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fff6f78112745ad8275eb5712c99455',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:43:35Z,use_quota=True,user_id='d6dd44720dd04f84ad3948ec6b983cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(945187d0-0f26-4f0c-b8a5-d1327ef60bf6),volume_type_id=945187d0-0f26-4f0c-b8a5-d1327ef60bf6)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:34 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67ede18f-d135-4834-98ff-0057ab382e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:34 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67ede18f-d135-4834-98ff-0057ab382e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:34 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7809ae2a-6537-4c0d-bf73-910dc8ba4409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:34 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7809ae2a-6537-4c0d-bf73-910dc8ba4409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb81c3d1-1f10-4d59-9737-94028dc1b089', 'volume_name': 'volume-fb81c3d1-1f10-4d59-9737-94028dc1b089', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:34 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdaaad45-6c32-47be-8a56-a706516adc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:34 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdaaad45-6c32-47be-8a56-a706516adc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:34 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf0d2f9-2d6f-4388-b027-c0eadb9473e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:34 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Volume fb81c3d1-1f10-4d59-9737-94028dc1b089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb81c3d1-1f10-4d59-9737-94028dc1b089', 'volume_size': 1} Apr 29 06:43:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b340d0e1-0030-49e4-854d-783956de1aa5,created_at=2026-04-29T04:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-347651134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b340d0e1-0030-49e4-854d-783956de1aa5,host='devstack@QuobyteHD#QuobyteHD',id=fb81c3d1-1f10-4d59-9737-94028dc1b089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fff6f78112745ad8275eb5712c99455',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:43:35Z,use_quota=True,user_id='d6dd44720dd04f84ad3948ec6b983cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(945187d0-0f26-4f0c-b8a5-d1327ef60bf6),volume_type_id=945187d0-0f26-4f0c-b8a5-d1327ef60bf6)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:43:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Creating volume fb81c3d1-1f10-4d59-9737-94028dc1b089 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:43:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:43:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:43:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:43:34 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:43:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fb81c3d1-1f10-4d59-9737-94028dc1b089 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:34 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fb81c3d1-1f10-4d59-9737-94028dc1b089 1073741824 Apr 29 06:43:34 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:35 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fb81c3d1-1f10-4d59-9737-94028dc1b089 1073741824" returned: 0 in 0.882s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fb81c3d1-1f10-4d59-9737-94028dc1b089 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:35 devstack sudo[90927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fb81c3d1-1f10-4d59-9737-94028dc1b089 Apr 29 06:43:35 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:36 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fb81c3d1-1f10-4d59-9737-94028dc1b089" returned: 0 in 0.649s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf0d2f9-2d6f-4388-b027-c0eadb9473e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb81c3d1-1f10-4d59-9737-94028dc1b089', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e03592-3e93-4428-9b6f-37ced490927e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:36 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Volume volume-fb81c3d1-1f10-4d59-9737-94028dc1b089 (fb81c3d1-1f10-4d59-9737-94028dc1b089): created successfully Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e03592-3e93-4428-9b6f-37ced490927e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Flow 'volume_create_manager' (a658c10c-96d5-40a8-a12b-e81ad06bb524) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:43:36 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-97b957e4-69da-467a-b20c-379b6722ea4f tempest-GroupsTest-37871535 None] Created volume successfully. Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG oslo_service.periodic_task [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84195) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:36 devstack sudo[90931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:43:36 devstack sudo[90931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Flow 'volume_create_manager' (5a342d8f-a502-41bc-b2e2-c4fbc71343dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb494b2-61dd-4c65-9e32-63dc8c897128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb494b2-61dd-4c65-9e32-63dc8c897128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1708003000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c2dfefc-60e4-4f49-8efd-5ecb61ab8c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db4cdea5becb46e091af0c20e5b40dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:43:37Z,use_quota=True,user_id='439558bc303b48278f6e128f4f715704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52714d17-5744-4b2b-9b91-3b465fb8d6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52714d17-5744-4b2b-9b91-3b465fb8d6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22fbbd8e-9c31-4448-9d0f-caf223e2a0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22fbbd8e-9c31-4448-9d0f-caf223e2a0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c2dfefc-60e4-4f49-8efd-5ecb61ab8c77', 'volume_name': 'volume-1c2dfefc-60e4-4f49-8efd-5ecb61ab8c77', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ed9d10-df91-4699-8871-02b33065cdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ed9d10-df91-4699-8871-02b33065cdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e021fb9-40bc-41a5-86b8-1b0892e4dbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:36 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Volume 1c2dfefc-60e4-4f49-8efd-5ecb61ab8c77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c2dfefc-60e4-4f49-8efd-5ecb61ab8c77', 'volume_size': 1} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1708003000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c2dfefc-60e4-4f49-8efd-5ecb61ab8c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db4cdea5becb46e091af0c20e5b40dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:43:37Z,use_quota=True,user_id='439558bc303b48278f6e128f4f715704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Creating volume 1c2dfefc-60e4-4f49-8efd-5ecb61ab8c77 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:43:36 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:43:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1c2dfefc-60e4-4f49-8efd-5ecb61ab8c77 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:36 devstack sudo[90952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1c2dfefc-60e4-4f49-8efd-5ecb61ab8c77 1073741824 Apr 29 06:43:36 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:37 devstack sudo[90931]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 1.044s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:37 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:43:38 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7153517d-3260-45f0-87ba-4491487debc8 tempest-GroupsTest-37871535 None] Acquiring lock "cinder-quobyte-fb81c3d1-1f10-4d59-9737-94028dc1b089" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:38 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7153517d-3260-45f0-87ba-4491487debc8 tempest-GroupsTest-37871535 None] Lock "cinder-quobyte-fb81c3d1-1f10-4d59-9737-94028dc1b089" acquired by "delete_volume" :: waited 0.020s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:38 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[269f32dc-52e5-458e-8155-4304ee61beb9]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:43:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7153517d-3260-45f0-87ba-4491487debc8 tempest-GroupsTest-37871535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fb81c3d1-1f10-4d59-9737-94028dc1b089 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:38 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fb81c3d1-1f10-4d59-9737-94028dc1b089 Apr 29 06:43:38 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:38 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1c2dfefc-60e4-4f49-8efd-5ecb61ab8c77 1073741824" returned: 0 in 1.487s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1c2dfefc-60e4-4f49-8efd-5ecb61ab8c77 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:38 devstack sudo[91007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1c2dfefc-60e4-4f49-8efd-5ecb61ab8c77 Apr 29 06:43:38 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:38 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7153517d-3260-45f0-87ba-4491487debc8 tempest-GroupsTest-37871535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fb81c3d1-1f10-4d59-9737-94028dc1b089" returned: 0 in 0.843s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7153517d-3260-45f0-87ba-4491487debc8 tempest-GroupsTest-37871535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fb81c3d1-1f10-4d59-9737-94028dc1b089 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:38 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fb81c3d1-1f10-4d59-9737-94028dc1b089 Apr 29 06:43:38 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:39 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1c2dfefc-60e4-4f49-8efd-5ecb61ab8c77" returned: 0 in 0.721s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:39 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] <== create_volume: return (2277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:43:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.289s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e021fb9-40bc-41a5-86b8-1b0892e4dbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c2dfefc-60e4-4f49-8efd-5ecb61ab8c77', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ce3dfa-bc06-47bc-9eb0-9d361a24b2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:39 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Volume volume-1c2dfefc-60e4-4f49-8efd-5ecb61ab8c77 (1c2dfefc-60e4-4f49-8efd-5ecb61ab8c77): created successfully Apr 29 06:43:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ce3dfa-bc06-47bc-9eb0-9d361a24b2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Flow 'volume_create_manager' (5a342d8f-a502-41bc-b2e2-c4fbc71343dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:43:39 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-82cd176b-7801-4044-9503-760a1b4e784e tempest-VolumeQuotasAdminTestJSON-378619277 None] Created volume successfully. Apr 29 06:43:39 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7153517d-3260-45f0-87ba-4491487debc8 tempest-GroupsTest-37871535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-fb81c3d1-1f10-4d59-9737-94028dc1b089" returned: 0 in 0.724s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:39 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7153517d-3260-45f0-87ba-4491487debc8 tempest-GroupsTest-37871535 None] Lock "cinder-quobyte-fb81c3d1-1f10-4d59-9737-94028dc1b089" released by "delete_volume" :: held 1.627s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:39 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-7153517d-3260-45f0-87ba-4491487debc8 tempest-GroupsTest-37871535 None] Created reservations ['9d6653b7-8392-4aab-ab26-add9ffdd9b6d'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:43:39 devstack cinder-volume[84195]: WARNING cinder.quota [None req-7153517d-3260-45f0-87ba-4491487debc8 tempest-GroupsTest-37871535 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2013607238 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2013607238, it is now deprecated. Please use the default quota class for default quota. Apr 29 06:43:39 devstack cinder-volume[84195]: WARNING cinder.quota [None req-7153517d-3260-45f0-87ba-4491487debc8 tempest-GroupsTest-37871535 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2013607238 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2013607238, it is now deprecated. Please use the default quota class for default quota. Apr 29 06:43:39 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-7153517d-3260-45f0-87ba-4491487debc8 tempest-GroupsTest-37871535 None] Created reservations ['81e5a9ec-b407-4bf0-8eee-aedb58954ca7', '6b631b34-094e-421e-9020-244746e9aae3', 'a0b7e2a8-9741-4e46-ad43-8ad558d57a4b', '264dd47f-e50e-4967-b920-8de873798aac'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:43:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7153517d-3260-45f0-87ba-4491487debc8 tempest-GroupsTest-37871535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7153517d-3260-45f0-87ba-4491487debc8 tempest-GroupsTest-37871535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:39 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-7153517d-3260-45f0-87ba-4491487debc8 tempest-GroupsTest-37871535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:43:39 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-7153517d-3260-45f0-87ba-4491487debc8 tempest-GroupsTest-37871535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:43:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7153517d-3260-45f0-87ba-4491487debc8 tempest-GroupsTest-37871535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7153517d-3260-45f0-87ba-4491487debc8 tempest-GroupsTest-37871535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:39 devstack sudo[91017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:43:40 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:40 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-b78a197a-fac5-4495-8cb4-333e5524c3b9 tempest-VolumeQuotasAdminTestJSON-378619277 None] Acquiring lock "cinder-1c2dfefc-60e4-4f49-8efd-5ecb61ab8c77-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:40 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-b78a197a-fac5-4495-8cb4-333e5524c3b9 tempest-VolumeQuotasAdminTestJSON-378619277 None] Lock "cinder-1c2dfefc-60e4-4f49-8efd-5ecb61ab8c77-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:40 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-b78a197a-fac5-4495-8cb4-333e5524c3b9 tempest-VolumeQuotasAdminTestJSON-378619277 None] Acquiring lock "cinder-quobyte-1c2dfefc-60e4-4f49-8efd-5ecb61ab8c77" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:40 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-b78a197a-fac5-4495-8cb4-333e5524c3b9 tempest-VolumeQuotasAdminTestJSON-378619277 None] Lock "cinder-quobyte-1c2dfefc-60e4-4f49-8efd-5ecb61ab8c77" acquired by "delete_volume" :: waited 0.017s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:40 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da95927-a876-4f1f-83e3-163a8a9c3396]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:43:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b78a197a-fac5-4495-8cb4-333e5524c3b9 tempest-VolumeQuotasAdminTestJSON-378619277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1c2dfefc-60e4-4f49-8efd-5ecb61ab8c77 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:40 devstack sudo[91019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1c2dfefc-60e4-4f49-8efd-5ecb61ab8c77 Apr 29 06:43:40 devstack sudo[91019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:40 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-4be663c0-e2a5-4a8f-a6d1-d1a1ec379875 tempest-GroupsTest-37871535 None] Created reservations ['16909d3b-d690-4200-8ad9-4b1a83fd5eb6'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:43:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4be663c0-e2a5-4a8f-a6d1-d1a1ec379875 tempest-GroupsTest-37871535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4be663c0-e2a5-4a8f-a6d1-d1a1ec379875 tempest-GroupsTest-37871535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:40 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4be663c0-e2a5-4a8f-a6d1-d1a1ec379875 tempest-GroupsTest-37871535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:43:40 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4be663c0-e2a5-4a8f-a6d1-d1a1ec379875 tempest-GroupsTest-37871535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:43:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4be663c0-e2a5-4a8f-a6d1-d1a1ec379875 tempest-GroupsTest-37871535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4be663c0-e2a5-4a8f-a6d1-d1a1ec379875 tempest-GroupsTest-37871535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:40 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:43:40 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:40 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7153517d-3260-45f0-87ba-4491487debc8 tempest-GroupsTest-37871535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.822s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:40 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-7153517d-3260-45f0-87ba-4491487debc8 tempest-GroupsTest-37871535 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:43:40 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-7153517d-3260-45f0-87ba-4491487debc8 tempest-GroupsTest-37871535 None] Delete group completed successfully. Apr 29 06:43:41 devstack sudo[91019]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b78a197a-fac5-4495-8cb4-333e5524c3b9 tempest-VolumeQuotasAdminTestJSON-378619277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1c2dfefc-60e4-4f49-8efd-5ecb61ab8c77" returned: 0 in 1.087s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b78a197a-fac5-4495-8cb4-333e5524c3b9 tempest-VolumeQuotasAdminTestJSON-378619277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1c2dfefc-60e4-4f49-8efd-5ecb61ab8c77 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:41 devstack sudo[91028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1c2dfefc-60e4-4f49-8efd-5ecb61ab8c77 Apr 29 06:43:41 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:41 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4be663c0-e2a5-4a8f-a6d1-d1a1ec379875 tempest-GroupsTest-37871535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.865s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:41 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-4be663c0-e2a5-4a8f-a6d1-d1a1ec379875 tempest-GroupsTest-37871535 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:43:41 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-4be663c0-e2a5-4a8f-a6d1-d1a1ec379875 tempest-GroupsTest-37871535 None] Delete group completed successfully. Apr 29 06:43:41 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b78a197a-fac5-4495-8cb4-333e5524c3b9 tempest-VolumeQuotasAdminTestJSON-378619277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1c2dfefc-60e4-4f49-8efd-5ecb61ab8c77" returned: 0 in 0.677s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:42 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-b78a197a-fac5-4495-8cb4-333e5524c3b9 tempest-VolumeQuotasAdminTestJSON-378619277 None] Lock "cinder-quobyte-1c2dfefc-60e4-4f49-8efd-5ecb61ab8c77" released by "delete_volume" :: held 1.813s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:42 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-b78a197a-fac5-4495-8cb4-333e5524c3b9 tempest-VolumeQuotasAdminTestJSON-378619277 None] Created reservations ['c5a672c3-82eb-4e86-8773-636a80d052c7', 'c6c8dc30-caaa-412e-a30c-00fd768723ca', '2435d1bd-5b75-4b9e-a3d3-a3da0fa5f302', '71632ff3-0d10-4940-815f-7b1d7cc20cfa'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:43:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-b78a197a-fac5-4495-8cb4-333e5524c3b9 tempest-VolumeQuotasAdminTestJSON-378619277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-b78a197a-fac5-4495-8cb4-333e5524c3b9 tempest-VolumeQuotasAdminTestJSON-378619277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:42 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-b78a197a-fac5-4495-8cb4-333e5524c3b9 tempest-VolumeQuotasAdminTestJSON-378619277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:43:42 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-b78a197a-fac5-4495-8cb4-333e5524c3b9 tempest-VolumeQuotasAdminTestJSON-378619277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:43:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-b78a197a-fac5-4495-8cb4-333e5524c3b9 tempest-VolumeQuotasAdminTestJSON-378619277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b78a197a-fac5-4495-8cb4-333e5524c3b9 tempest-VolumeQuotasAdminTestJSON-378619277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:42 devstack sudo[91032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:43:42 devstack sudo[91032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:42 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-f10b58c7-6a28-462f-b2db-6d3c2c191693 tempest-GroupsTest-37871535 None] Group tempest-GroupsTest-Group-302810915: creating Apr 29 06:43:42 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-f10b58c7-6a28-462f-b2db-6d3c2c191693 tempest-GroupsTest-37871535 None] Group tempest-GroupsTest-Group-302810915: created successfully Apr 29 06:43:42 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-f10b58c7-6a28-462f-b2db-6d3c2c191693 tempest-GroupsTest-37871535 None] Create group completed successfully. Apr 29 06:43:42 devstack sudo[91032]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b78a197a-fac5-4495-8cb4-333e5524c3b9 tempest-VolumeQuotasAdminTestJSON-378619277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.759s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:42 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-b78a197a-fac5-4495-8cb4-333e5524c3b9 tempest-VolumeQuotasAdminTestJSON-378619277 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:43:42 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-b78a197a-fac5-4495-8cb4-333e5524c3b9 tempest-VolumeQuotasAdminTestJSON-378619277 None] Deleted volume successfully. Apr 29 06:43:42 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-b78a197a-fac5-4495-8cb4-333e5524c3b9 tempest-VolumeQuotasAdminTestJSON-378619277 None] Lock "cinder-1c2dfefc-60e4-4f49-8efd-5ecb61ab8c77-delete_volume" released by "delete_volume" :: held 2.821s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Flow 'volume_create_manager' (f7934b13-bf8b-4042-a7fa-22c25c7f16ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e22c8e-25d8-4b8b-8959-b7b20968b904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e22c8e-25d8-4b8b-8959-b7b20968b904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-490705954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01ecffb9-3012-4881-ba0c-cb92b3a47c95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db4cdea5becb46e091af0c20e5b40dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:43:43Z,use_quota=True,user_id='439558bc303b48278f6e128f4f715704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc8d58a5-ed9c-4d3b-af9b-61801a107bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc8d58a5-ed9c-4d3b-af9b-61801a107bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52dacb90-d653-4bf9-8797-59989b34c201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52dacb90-d653-4bf9-8797-59989b34c201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01ecffb9-3012-4881-ba0c-cb92b3a47c95', 'volume_name': 'volume-01ecffb9-3012-4881-ba0c-cb92b3a47c95', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb25eb71-f873-4244-9b15-f65a745c45d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb25eb71-f873-4244-9b15-f65a745c45d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f82536-b60d-41f9-9fc5-dd131af7f08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:43 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Volume 01ecffb9-3012-4881-ba0c-cb92b3a47c95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01ecffb9-3012-4881-ba0c-cb92b3a47c95', 'volume_size': 1} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-490705954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01ecffb9-3012-4881-ba0c-cb92b3a47c95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db4cdea5becb46e091af0c20e5b40dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:43:43Z,use_quota=True,user_id='439558bc303b48278f6e128f4f715704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Creating volume 01ecffb9-3012-4881-ba0c-cb92b3a47c95 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:43:43 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-01ecffb9-3012-4881-ba0c-cb92b3a47c95 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:43 devstack sudo[91075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-01ecffb9-3012-4881-ba0c-cb92b3a47c95 1073741824 Apr 29 06:43:43 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Flow 'volume_create_manager' (8fda5295-c5bf-4673-a71e-5551e5af98fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600996fa-39a6-4e26-8395-0ab214a1167d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600996fa-39a6-4e26-8395-0ab214a1167d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1540152474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=297a697e-e340-41d9-8f99-a4fe585e1a59,host='devstack@QuobyteHD#QuobyteHD',id=07c2d664-bd3b-40f0-9d72-d9dd5b7336d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fff6f78112745ad8275eb5712c99455',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:43:44Z,use_quota=True,user_id='d6dd44720dd04f84ad3948ec6b983cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e14acb6-c998-45b8-b92d-d554d8f96e2d),volume_type_id=5e14acb6-c998-45b8-b92d-d554d8f96e2d)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf56e01-8453-4647-b8d0-1ae63a7017ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf56e01-8453-4647-b8d0-1ae63a7017ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac3b548-2b96-447b-9131-fd4c0e057924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac3b548-2b96-447b-9131-fd4c0e057924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07c2d664-bd3b-40f0-9d72-d9dd5b7336d3', 'volume_name': 'volume-07c2d664-bd3b-40f0-9d72-d9dd5b7336d3', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5049c6a-1710-44c8-9a17-36a8facd8354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5049c6a-1710-44c8-9a17-36a8facd8354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e432f2-fffd-4e74-8220-c55470fc0664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:43 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Volume 07c2d664-bd3b-40f0-9d72-d9dd5b7336d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07c2d664-bd3b-40f0-9d72-d9dd5b7336d3', 'volume_size': 1} Apr 29 06:43:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:44 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-01ecffb9-3012-4881-ba0c-cb92b3a47c95 1073741824" returned: 0 in 0.835s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-01ecffb9-3012-4881-ba0c-cb92b3a47c95 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:44 devstack sudo[91081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-01ecffb9-3012-4881-ba0c-cb92b3a47c95 Apr 29 06:43:44 devstack sudo[91081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:44 devstack sudo[91081]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-01ecffb9-3012-4881-ba0c-cb92b3a47c95" returned: 0 in 0.648s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:43:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.801s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=297a697e-e340-41d9-8f99-a4fe585e1a59,created_at=2026-04-29T04:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1540152474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=297a697e-e340-41d9-8f99-a4fe585e1a59,host='devstack@QuobyteHD#QuobyteHD',id=07c2d664-bd3b-40f0-9d72-d9dd5b7336d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fff6f78112745ad8275eb5712c99455',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:43:44Z,use_quota=True,user_id='d6dd44720dd04f84ad3948ec6b983cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e14acb6-c998-45b8-b92d-d554d8f96e2d),volume_type_id=5e14acb6-c998-45b8-b92d-d554d8f96e2d)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:43:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Creating volume 07c2d664-bd3b-40f0-9d72-d9dd5b7336d3 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:43:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:43:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:43:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:43:44 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:43:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-07c2d664-bd3b-40f0-9d72-d9dd5b7336d3 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f82536-b60d-41f9-9fc5-dd131af7f08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01ecffb9-3012-4881-ba0c-cb92b3a47c95', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:44 devstack sudo[91085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-07c2d664-bd3b-40f0-9d72-d9dd5b7336d3 1073741824 Apr 29 06:43:44 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229f5139-1f3d-4b0f-aa9f-dbd7a681ed5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:44 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Volume volume-01ecffb9-3012-4881-ba0c-cb92b3a47c95 (01ecffb9-3012-4881-ba0c-cb92b3a47c95): created successfully Apr 29 06:43:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229f5139-1f3d-4b0f-aa9f-dbd7a681ed5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Flow 'volume_create_manager' (f7934b13-bf8b-4042-a7fa-22c25c7f16ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:43:44 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-f5126402-c17f-466a-8d81-a32a8000277d tempest-VolumeQuotasAdminTestJSON-378619277 None] Created volume successfully. Apr 29 06:43:45 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-07c2d664-bd3b-40f0-9d72-d9dd5b7336d3 1073741824" returned: 0 in 0.878s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-07c2d664-bd3b-40f0-9d72-d9dd5b7336d3 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:45 devstack sudo[91090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-07c2d664-bd3b-40f0-9d72-d9dd5b7336d3 Apr 29 06:43:45 devstack sudo[91090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:45 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-02012e89-6368-4e28-b812-a365ec1adc52 tempest-VolumeQuotasAdminTestJSON-803653566 None] Transfer volume completed successfully. Apr 29 06:43:46 devstack sudo[91090]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-07c2d664-bd3b-40f0-9d72-d9dd5b7336d3" returned: 0 in 0.646s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:43:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e432f2-fffd-4e74-8220-c55470fc0664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07c2d664-bd3b-40f0-9d72-d9dd5b7336d3', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff519833-7155-4891-9449-b4f59da849f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:46 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Volume volume-07c2d664-bd3b-40f0-9d72-d9dd5b7336d3 (07c2d664-bd3b-40f0-9d72-d9dd5b7336d3): created successfully Apr 29 06:43:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff519833-7155-4891-9449-b4f59da849f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Flow 'volume_create_manager' (8fda5295-c5bf-4673-a71e-5551e5af98fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:43:46 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-5a0c6b1e-e54a-4762-9370-d0f454553345 tempest-GroupsTest-37871535 None] Created volume successfully. Apr 29 06:43:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-b18e8186-336a-4398-a015-e76fe33a0246 tempest-VolumeQuotasAdminTestJSON-556360959 None] Acquiring lock "cinder-01ecffb9-3012-4881-ba0c-cb92b3a47c95-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-b18e8186-336a-4398-a015-e76fe33a0246 tempest-VolumeQuotasAdminTestJSON-556360959 None] Lock "cinder-01ecffb9-3012-4881-ba0c-cb92b3a47c95-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-b18e8186-336a-4398-a015-e76fe33a0246 tempest-VolumeQuotasAdminTestJSON-556360959 None] Acquiring lock "cinder-quobyte-01ecffb9-3012-4881-ba0c-cb92b3a47c95" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-b18e8186-336a-4398-a015-e76fe33a0246 tempest-VolumeQuotasAdminTestJSON-556360959 None] Lock "cinder-quobyte-01ecffb9-3012-4881-ba0c-cb92b3a47c95" acquired by "delete_volume" :: waited 0.017s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:46 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[3084828e-39b2-43a0-9131-037074abb4a5]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:43:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b18e8186-336a-4398-a015-e76fe33a0246 tempest-VolumeQuotasAdminTestJSON-556360959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-01ecffb9-3012-4881-ba0c-cb92b3a47c95 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:46 devstack sudo[91095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-01ecffb9-3012-4881-ba0c-cb92b3a47c95 Apr 29 06:43:46 devstack sudo[91095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:47 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:43:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Flow 'volume_create_manager' (f4680c81-4b5b-4c68-86d0-07e645860677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:43:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a0778f-88cb-4b42-a637-3e255c24ddef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a0778f-88cb-4b42-a637-3e255c24ddef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-417459580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=297a697e-e340-41d9-8f99-a4fe585e1a59,host='devstack@QuobyteHD#QuobyteHD',id=f06b72de-d570-48c7-bbf9-07e8ce16454f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fff6f78112745ad8275eb5712c99455',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:43:48Z,use_quota=True,user_id='d6dd44720dd04f84ad3948ec6b983cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e14acb6-c998-45b8-b92d-d554d8f96e2d),volume_type_id=5e14acb6-c998-45b8-b92d-d554d8f96e2d)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01b54a4f-fb2a-45d9-a66b-80ca6c276b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01b54a4f-fb2a-45d9-a66b-80ca6c276b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82cb98d5-dc5c-41b3-bf5b-2651d6b4992b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:47 devstack sudo[91095]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82cb98d5-dc5c-41b3-bf5b-2651d6b4992b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f06b72de-d570-48c7-bbf9-07e8ce16454f', 'volume_name': 'volume-f06b72de-d570-48c7-bbf9-07e8ce16454f', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61df14b8-8038-475f-9c86-5f5ff5bc37a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61df14b8-8038-475f-9c86-5f5ff5bc37a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74508284-cbec-4d3a-967d-c5f1e3e8f404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:47 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Volume f06b72de-d570-48c7-bbf9-07e8ce16454f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f06b72de-d570-48c7-bbf9-07e8ce16454f', 'volume_size': 1} Apr 29 06:43:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=297a697e-e340-41d9-8f99-a4fe585e1a59,created_at=2026-04-29T04:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-417459580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=297a697e-e340-41d9-8f99-a4fe585e1a59,host='devstack@QuobyteHD#QuobyteHD',id=f06b72de-d570-48c7-bbf9-07e8ce16454f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fff6f78112745ad8275eb5712c99455',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:43:48Z,use_quota=True,user_id='d6dd44720dd04f84ad3948ec6b983cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e14acb6-c998-45b8-b92d-d554d8f96e2d),volume_type_id=5e14acb6-c998-45b8-b92d-d554d8f96e2d)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:43:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Creating volume f06b72de-d570-48c7-bbf9-07e8ce16454f {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:43:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:43:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:43:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:43:47 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:43:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f06b72de-d570-48c7-bbf9-07e8ce16454f 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b18e8186-336a-4398-a015-e76fe33a0246 tempest-VolumeQuotasAdminTestJSON-556360959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-01ecffb9-3012-4881-ba0c-cb92b3a47c95" returned: 0 in 0.856s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b18e8186-336a-4398-a015-e76fe33a0246 tempest-VolumeQuotasAdminTestJSON-556360959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-01ecffb9-3012-4881-ba0c-cb92b3a47c95 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:47 devstack sudo[91100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f06b72de-d570-48c7-bbf9-07e8ce16454f 1073741824 Apr 29 06:43:47 devstack sudo[91100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:47 devstack sudo[91101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-01ecffb9-3012-4881-ba0c-cb92b3a47c95 Apr 29 06:43:47 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:48 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b18e8186-336a-4398-a015-e76fe33a0246 tempest-VolumeQuotasAdminTestJSON-556360959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-01ecffb9-3012-4881-ba0c-cb92b3a47c95" returned: 0 in 0.668s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:48 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-b18e8186-336a-4398-a015-e76fe33a0246 tempest-VolumeQuotasAdminTestJSON-556360959 None] Lock "cinder-quobyte-01ecffb9-3012-4881-ba0c-cb92b3a47c95" released by "delete_volume" :: held 1.570s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:48 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-b18e8186-336a-4398-a015-e76fe33a0246 tempest-VolumeQuotasAdminTestJSON-556360959 None] Created reservations ['71d39d64-e382-4269-a6e9-9d1219709232', '73c0bf51-5c63-48f0-983c-1edc6ded913b', 'b7b3a98e-a6cd-4dad-bdcd-1ea0de33f31f', 'a19a48a9-5af0-46bf-9ca8-110f8732c02f'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:43:48 devstack sudo[91100]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f06b72de-d570-48c7-bbf9-07e8ce16454f 1073741824" returned: 0 in 0.786s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-b18e8186-336a-4398-a015-e76fe33a0246 tempest-VolumeQuotasAdminTestJSON-556360959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-b18e8186-336a-4398-a015-e76fe33a0246 tempest-VolumeQuotasAdminTestJSON-556360959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:48 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-b18e8186-336a-4398-a015-e76fe33a0246 tempest-VolumeQuotasAdminTestJSON-556360959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:43:48 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-b18e8186-336a-4398-a015-e76fe33a0246 tempest-VolumeQuotasAdminTestJSON-556360959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:43:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-b18e8186-336a-4398-a015-e76fe33a0246 tempest-VolumeQuotasAdminTestJSON-556360959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b18e8186-336a-4398-a015-e76fe33a0246 tempest-VolumeQuotasAdminTestJSON-556360959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f06b72de-d570-48c7-bbf9-07e8ce16454f {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:48 devstack sudo[91108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:43:48 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:48 devstack sudo[91109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f06b72de-d570-48c7-bbf9-07e8ce16454f Apr 29 06:43:48 devstack sudo[91109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:49 devstack sudo[91109]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f06b72de-d570-48c7-bbf9-07e8ce16454f" returned: 0 in 0.671s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:43:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:49 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74508284-cbec-4d3a-967d-c5f1e3e8f404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f06b72de-d570-48c7-bbf9-07e8ce16454f', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0855064c-86fb-4fc5-a3a1-2c06f4d4b9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b18e8186-336a-4398-a015-e76fe33a0246 tempest-VolumeQuotasAdminTestJSON-556360959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.725s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:49 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-b18e8186-336a-4398-a015-e76fe33a0246 tempest-VolumeQuotasAdminTestJSON-556360959 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:43:49 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-b18e8186-336a-4398-a015-e76fe33a0246 tempest-VolumeQuotasAdminTestJSON-556360959 None] Deleted volume successfully. Apr 29 06:43:49 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Volume volume-f06b72de-d570-48c7-bbf9-07e8ce16454f (f06b72de-d570-48c7-bbf9-07e8ce16454f): created successfully Apr 29 06:43:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0855064c-86fb-4fc5-a3a1-2c06f4d4b9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Flow 'volume_create_manager' (f4680c81-4b5b-4c68-86d0-07e645860677) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:43:49 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-c6cdd068-45cb-4025-9f2d-e68efae9c7ee tempest-GroupsTest-37871535 None] Created volume successfully. Apr 29 06:43:49 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-b18e8186-336a-4398-a015-e76fe33a0246 tempest-VolumeQuotasAdminTestJSON-556360959 None] Lock "cinder-01ecffb9-3012-4881-ba0c-cb92b3a47c95-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:50 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-be8f8408-399e-487b-b0fd-c3187cd1c925 tempest-GroupsTest-37871535 None] Update group completed successfully. Apr 29 06:43:51 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-56bf3666-9c14-4aa3-ac2b-4c3bb34b537e tempest-GroupsTest-37871535 None] Update group completed successfully. Apr 29 06:43:52 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-d5d11458-a729-4b04-b7af-61bb9ea57bf9 tempest-GroupsTest-37871535 None] Acquiring lock "cinder-quobyte-07c2d664-bd3b-40f0-9d72-d9dd5b7336d3" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:52 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-d5d11458-a729-4b04-b7af-61bb9ea57bf9 tempest-GroupsTest-37871535 None] Lock "cinder-quobyte-07c2d664-bd3b-40f0-9d72-d9dd5b7336d3" acquired by "delete_volume" :: waited 0.027s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:52 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f38aec9-8550-40a3-a085-ff2e69b4bafd]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:43:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d5d11458-a729-4b04-b7af-61bb9ea57bf9 tempest-GroupsTest-37871535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-07c2d664-bd3b-40f0-9d72-d9dd5b7336d3 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:53 devstack sudo[91116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-07c2d664-bd3b-40f0-9d72-d9dd5b7336d3 Apr 29 06:43:53 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:53 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d5d11458-a729-4b04-b7af-61bb9ea57bf9 tempest-GroupsTest-37871535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-07c2d664-bd3b-40f0-9d72-d9dd5b7336d3" returned: 0 in 0.815s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d5d11458-a729-4b04-b7af-61bb9ea57bf9 tempest-GroupsTest-37871535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-07c2d664-bd3b-40f0-9d72-d9dd5b7336d3 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:53 devstack sudo[91121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-07c2d664-bd3b-40f0-9d72-d9dd5b7336d3 Apr 29 06:43:53 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:54 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d5d11458-a729-4b04-b7af-61bb9ea57bf9 tempest-GroupsTest-37871535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-07c2d664-bd3b-40f0-9d72-d9dd5b7336d3" returned: 0 in 0.644s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:54 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-d5d11458-a729-4b04-b7af-61bb9ea57bf9 tempest-GroupsTest-37871535 None] Lock "cinder-quobyte-07c2d664-bd3b-40f0-9d72-d9dd5b7336d3" released by "delete_volume" :: held 1.536s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:54 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-d5d11458-a729-4b04-b7af-61bb9ea57bf9 tempest-GroupsTest-37871535 None] Acquiring lock "cinder-quobyte-f06b72de-d570-48c7-bbf9-07e8ce16454f" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:54 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-d5d11458-a729-4b04-b7af-61bb9ea57bf9 tempest-GroupsTest-37871535 None] Lock "cinder-quobyte-f06b72de-d570-48c7-bbf9-07e8ce16454f" acquired by "delete_volume" :: waited 0.016s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:54 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1496529-96f2-4706-96c2-ef938c1ba045]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:43:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d5d11458-a729-4b04-b7af-61bb9ea57bf9 tempest-GroupsTest-37871535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f06b72de-d570-48c7-bbf9-07e8ce16454f {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:54 devstack sudo[91124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f06b72de-d570-48c7-bbf9-07e8ce16454f Apr 29 06:43:54 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:55 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d5d11458-a729-4b04-b7af-61bb9ea57bf9 tempest-GroupsTest-37871535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f06b72de-d570-48c7-bbf9-07e8ce16454f" returned: 0 in 0.875s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d5d11458-a729-4b04-b7af-61bb9ea57bf9 tempest-GroupsTest-37871535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f06b72de-d570-48c7-bbf9-07e8ce16454f {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:55 devstack sudo[91129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f06b72de-d570-48c7-bbf9-07e8ce16454f Apr 29 06:43:55 devstack sudo[91129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7a3f900d-4d94-477f-b0dc-1b47405e4508 tempest-VolumesNegativeTest-705297189 None] Acquiring lock "cinder-15d64c7e-2ef4-413a-adfd-14bcd4daa945-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7a3f900d-4d94-477f-b0dc-1b47405e4508 tempest-VolumesNegativeTest-705297189 None] Lock "cinder-15d64c7e-2ef4-413a-adfd-14bcd4daa945-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7a3f900d-4d94-477f-b0dc-1b47405e4508 tempest-VolumesNegativeTest-705297189 None] Acquiring lock "cinder-quobyte-15d64c7e-2ef4-413a-adfd-14bcd4daa945" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:43:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7a3f900d-4d94-477f-b0dc-1b47405e4508 tempest-VolumesNegativeTest-705297189 None] Lock "cinder-quobyte-15d64c7e-2ef4-413a-adfd-14bcd4daa945" acquired by "delete_volume" :: waited 0.022s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:43:55 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[db782bbc-bfe2-4c27-ae64-60f1b7406c23]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:43:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7a3f900d-4d94-477f-b0dc-1b47405e4508 tempest-VolumesNegativeTest-705297189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-15d64c7e-2ef4-413a-adfd-14bcd4daa945 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:56 devstack sudo[91131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-15d64c7e-2ef4-413a-adfd-14bcd4daa945 Apr 29 06:43:56 devstack sudo[91131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:56 devstack sudo[91129]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d5d11458-a729-4b04-b7af-61bb9ea57bf9 tempest-GroupsTest-37871535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-f06b72de-d570-48c7-bbf9-07e8ce16454f" returned: 0 in 0.710s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-d5d11458-a729-4b04-b7af-61bb9ea57bf9 tempest-GroupsTest-37871535 None] Lock "cinder-quobyte-f06b72de-d570-48c7-bbf9-07e8ce16454f" released by "delete_volume" :: held 1.631s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-d5d11458-a729-4b04-b7af-61bb9ea57bf9 tempest-GroupsTest-37871535 None] Created reservations ['893a3a22-761c-4925-8ed8-000b56f00ff0'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:43:56 devstack cinder-volume[84195]: WARNING cinder.quota [None req-d5d11458-a729-4b04-b7af-61bb9ea57bf9 tempest-GroupsTest-37871535 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1513803043 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1513803043, it is now deprecated. Please use the default quota class for default quota. Apr 29 06:43:56 devstack cinder-volume[84195]: WARNING cinder.quota [None req-d5d11458-a729-4b04-b7af-61bb9ea57bf9 tempest-GroupsTest-37871535 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1513803043 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1513803043, it is now deprecated. Please use the default quota class for default quota. Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-d5d11458-a729-4b04-b7af-61bb9ea57bf9 tempest-GroupsTest-37871535 None] Created reservations ['bc6cf68d-8a6a-41f5-9bbd-59459ca594ee', '69ddb67c-9411-4885-a0bc-afe335261e03', 'd21e1e85-3759-4c1f-bd0c-66f6a60438cc', '1a707176-1ba2-40ba-9c03-d54d2cd19b04'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-d5d11458-a729-4b04-b7af-61bb9ea57bf9 tempest-GroupsTest-37871535 None] Created reservations ['69970fbe-8b71-45f5-a649-0863d0e8f8f8', '2ac6eb61-9d2e-461e-b8f4-99b0df185f39', 'c0185c2d-feed-4bbc-91ed-afe830af32e1', '87700006-e980-4727-af06-adf577d7a44c'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d5d11458-a729-4b04-b7af-61bb9ea57bf9 tempest-GroupsTest-37871535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d5d11458-a729-4b04-b7af-61bb9ea57bf9 tempest-GroupsTest-37871535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d5d11458-a729-4b04-b7af-61bb9ea57bf9 tempest-GroupsTest-37871535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d5d11458-a729-4b04-b7af-61bb9ea57bf9 tempest-GroupsTest-37871535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d5d11458-a729-4b04-b7af-61bb9ea57bf9 tempest-GroupsTest-37871535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d5d11458-a729-4b04-b7af-61bb9ea57bf9 tempest-GroupsTest-37871535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:56 devstack sudo[91135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:43:56 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Flow 'volume_create_manager' (8e92410e-61f8-4135-a093-a2d66223bf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db003e3c-a120-491b-b5b8-1436a7cd0b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:56 devstack sudo[91131]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7a3f900d-4d94-477f-b0dc-1b47405e4508 tempest-VolumesNegativeTest-705297189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-15d64c7e-2ef4-413a-adfd-14bcd4daa945" returned: 0 in 0.820s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7a3f900d-4d94-477f-b0dc-1b47405e4508 tempest-VolumesNegativeTest-705297189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-15d64c7e-2ef4-413a-adfd-14bcd4daa945 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db003e3c-a120-491b-b5b8-1436a7cd0b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2088122044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ea4d86-1cd5-40e7-8e15-d79e2a6bbd53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96cb6a26ec1b45e3b52cb0fb9ec74ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:43:57Z,use_quota=True,user_id='4484590cccd045869732c2355438858d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2793ad1-ab9d-4f83-b475-f10ea6e0d82c),volume_type_id=d2793ad1-ab9d-4f83-b475-f10ea6e0d82c)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df590063-b346-4d56-aeff-e20eb2bf7683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:56 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-15d64c7e-2ef4-413a-adfd-14bcd4daa945 Apr 29 06:43:56 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df590063-b346-4d56-aeff-e20eb2bf7683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b68fef3b-6db7-4d46-be3e-49837447b5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b68fef3b-6db7-4d46-be3e-49837447b5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56ea4d86-1cd5-40e7-8e15-d79e2a6bbd53', 'volume_name': 'volume-56ea4d86-1cd5-40e7-8e15-d79e2a6bbd53', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12b8bf92-62cf-4aa4-9516-387e219b0a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12b8bf92-62cf-4aa4-9516-387e219b0a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af495743-7f5b-49e8-a34a-e2bf27c62b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:56 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Volume 56ea4d86-1cd5-40e7-8e15-d79e2a6bbd53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56ea4d86-1cd5-40e7-8e15-d79e2a6bbd53', 'volume_size': 1} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2088122044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ea4d86-1cd5-40e7-8e15-d79e2a6bbd53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96cb6a26ec1b45e3b52cb0fb9ec74ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:43:57Z,use_quota=True,user_id='4484590cccd045869732c2355438858d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2793ad1-ab9d-4f83-b475-f10ea6e0d82c),volume_type_id=d2793ad1-ab9d-4f83-b475-f10ea6e0d82c)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Creating volume 56ea4d86-1cd5-40e7-8e15-d79e2a6bbd53 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:43:56 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:43:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-56ea4d86-1cd5-40e7-8e15-d79e2a6bbd53 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:56 devstack sudo[91143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-56ea4d86-1cd5-40e7-8e15-d79e2a6bbd53 1073741824 Apr 29 06:43:56 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:57 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d5d11458-a729-4b04-b7af-61bb9ea57bf9 tempest-GroupsTest-37871535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.704s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:57 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-d5d11458-a729-4b04-b7af-61bb9ea57bf9 tempest-GroupsTest-37871535 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:43:57 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-d5d11458-a729-4b04-b7af-61bb9ea57bf9 tempest-GroupsTest-37871535 None] Delete group completed successfully. Apr 29 06:43:57 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7a3f900d-4d94-477f-b0dc-1b47405e4508 tempest-VolumesNegativeTest-705297189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-15d64c7e-2ef4-413a-adfd-14bcd4daa945" returned: 0 in 0.647s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:57 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7a3f900d-4d94-477f-b0dc-1b47405e4508 tempest-VolumesNegativeTest-705297189 None] Lock "cinder-quobyte-15d64c7e-2ef4-413a-adfd-14bcd4daa945" released by "delete_volume" :: held 1.525s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:57 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-7a3f900d-4d94-477f-b0dc-1b47405e4508 tempest-VolumesNegativeTest-705297189 None] Created reservations ['9c066c4b-257d-47f6-8d87-815b1dee6e45', '26de1089-983e-47b7-b1c5-bccb7d8ed629', '682f80a6-cd53-46cd-a6a2-f6e0274b06a6', '2b3f7cb5-f01f-47df-b7cd-dec7df587f83'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:43:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7a3f900d-4d94-477f-b0dc-1b47405e4508 tempest-VolumesNegativeTest-705297189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7a3f900d-4d94-477f-b0dc-1b47405e4508 tempest-VolumesNegativeTest-705297189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:57 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-7a3f900d-4d94-477f-b0dc-1b47405e4508 tempest-VolumesNegativeTest-705297189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:43:57 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-7a3f900d-4d94-477f-b0dc-1b47405e4508 tempest-VolumesNegativeTest-705297189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:43:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7a3f900d-4d94-477f-b0dc-1b47405e4508 tempest-VolumesNegativeTest-705297189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7a3f900d-4d94-477f-b0dc-1b47405e4508 tempest-VolumesNegativeTest-705297189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:57 devstack sudo[91151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:43:57 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:57 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-56ea4d86-1cd5-40e7-8e15-d79e2a6bbd53 1073741824" returned: 0 in 0.909s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-56ea4d86-1cd5-40e7-8e15-d79e2a6bbd53 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:57 devstack sudo[91153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-56ea4d86-1cd5-40e7-8e15-d79e2a6bbd53 Apr 29 06:43:57 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:43:58 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7a3f900d-4d94-477f-b0dc-1b47405e4508 tempest-VolumesNegativeTest-705297189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.708s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:58 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-7a3f900d-4d94-477f-b0dc-1b47405e4508 tempest-VolumesNegativeTest-705297189 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:43:58 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-7a3f900d-4d94-477f-b0dc-1b47405e4508 tempest-VolumesNegativeTest-705297189 None] Deleted volume successfully. Apr 29 06:43:58 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7a3f900d-4d94-477f-b0dc-1b47405e4508 tempest-VolumesNegativeTest-705297189 None] Lock "cinder-15d64c7e-2ef4-413a-adfd-14bcd4daa945-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:43:58 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root Apr 29 06:43:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-56ea4d86-1cd5-40e7-8e15-d79e2a6bbd53" returned: 0 in 0.680s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:43:58 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:43:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:58 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af495743-7f5b-49e8-a34a-e2bf27c62b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56ea4d86-1cd5-40e7-8e15-d79e2a6bbd53', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:58 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937d9a5f-c158-40da-a9ab-f8bb22c38d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:43:58 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Volume volume-56ea4d86-1cd5-40e7-8e15-d79e2a6bbd53 (56ea4d86-1cd5-40e7-8e15-d79e2a6bbd53): created successfully Apr 29 06:43:58 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937d9a5f-c158-40da-a9ab-f8bb22c38d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:43:58 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Flow 'volume_create_manager' (8e92410e-61f8-4135-a093-a2d66223bf6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:43:58 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-2df0efd5-a746-4bb1-b991-73460fe44fdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Created volume successfully. Apr 29 06:43:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-03ee56ef-2115-4fdc-8f8e-cf1c73f20460 tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:43:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-03ee56ef-2115-4fdc-8f8e-cf1c73f20460 tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:43:59 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-03ee56ef-2115-4fdc-8f8e-cf1c73f20460 tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:43:59 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-03ee56ef-2115-4fdc-8f8e-cf1c73f20460 tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:43:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-03ee56ef-2115-4fdc-8f8e-cf1c73f20460 tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:43:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-03ee56ef-2115-4fdc-8f8e-cf1c73f20460 tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:43:59 devstack sudo[91157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:43:59 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:00 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-03ee56ef-2115-4fdc-8f8e-cf1c73f20460 tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.692s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:00 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-03ee56ef-2115-4fdc-8f8e-cf1c73f20460 tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:44:00 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-03ee56ef-2115-4fdc-8f8e-cf1c73f20460 tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Retype volume completed successfully. Apr 29 06:44:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2c4f56bc-f7aa-40d1-8da8-c5837c777bdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Acquiring lock "cinder-56ea4d86-1cd5-40e7-8e15-d79e2a6bbd53-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:44:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2c4f56bc-f7aa-40d1-8da8-c5837c777bdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Lock "cinder-56ea4d86-1cd5-40e7-8e15-d79e2a6bbd53-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:44:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2c4f56bc-f7aa-40d1-8da8-c5837c777bdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Acquiring lock "cinder-quobyte-56ea4d86-1cd5-40e7-8e15-d79e2a6bbd53" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:44:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2c4f56bc-f7aa-40d1-8da8-c5837c777bdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Lock "cinder-quobyte-56ea4d86-1cd5-40e7-8e15-d79e2a6bbd53" acquired by "delete_volume" :: waited 0.020s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:44:00 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e70881-228b-4b12-a684-122b60cf5665]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:44:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2c4f56bc-f7aa-40d1-8da8-c5837c777bdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-56ea4d86-1cd5-40e7-8e15-d79e2a6bbd53 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:00 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-56ea4d86-1cd5-40e7-8e15-d79e2a6bbd53 Apr 29 06:44:00 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:01 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2c4f56bc-f7aa-40d1-8da8-c5837c777bdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-56ea4d86-1cd5-40e7-8e15-d79e2a6bbd53" returned: 0 in 0.850s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2c4f56bc-f7aa-40d1-8da8-c5837c777bdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-56ea4d86-1cd5-40e7-8e15-d79e2a6bbd53 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:01 devstack sudo[91165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-56ea4d86-1cd5-40e7-8e15-d79e2a6bbd53 Apr 29 06:44:01 devstack sudo[91165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:02 devstack sudo[91165]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2c4f56bc-f7aa-40d1-8da8-c5837c777bdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-56ea4d86-1cd5-40e7-8e15-d79e2a6bbd53" returned: 0 in 0.674s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:02 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2c4f56bc-f7aa-40d1-8da8-c5837c777bdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Lock "cinder-quobyte-56ea4d86-1cd5-40e7-8e15-d79e2a6bbd53" released by "delete_volume" :: held 1.579s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:44:02 devstack cinder-volume[84195]: WARNING cinder.quota [None req-2c4f56bc-f7aa-40d1-8da8-c5837c777bdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 29 06:44:02 devstack cinder-volume[84195]: WARNING cinder.quota [None req-2c4f56bc-f7aa-40d1-8da8-c5837c777bdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 29 06:44:02 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-2c4f56bc-f7aa-40d1-8da8-c5837c777bdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Created reservations ['4d9e21d6-d540-4735-83df-c7d287901ac7', '82af9dee-7170-450a-962d-fec8b892c837', 'b30a5749-39ed-4498-bf93-72b44875a1e4', '60cb7791-92e2-43bf-9c6a-27459fc72024'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:44:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2c4f56bc-f7aa-40d1-8da8-c5837c777bdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2c4f56bc-f7aa-40d1-8da8-c5837c777bdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:02 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2c4f56bc-f7aa-40d1-8da8-c5837c777bdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:44:02 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2c4f56bc-f7aa-40d1-8da8-c5837c777bdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:44:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2c4f56bc-f7aa-40d1-8da8-c5837c777bdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:44:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2c4f56bc-f7aa-40d1-8da8-c5837c777bdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:02 devstack sudo[91168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:44:02 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:03 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2c4f56bc-f7aa-40d1-8da8-c5837c777bdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.774s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:03 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-2c4f56bc-f7aa-40d1-8da8-c5837c777bdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:44:03 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-2c4f56bc-f7aa-40d1-8da8-c5837c777bdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Deleted volume successfully. Apr 29 06:44:03 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2c4f56bc-f7aa-40d1-8da8-c5837c777bdd tempest-VolumeRetypeWithoutMigrationTest-1275866776 None] Lock "cinder-56ea4d86-1cd5-40e7-8e15-d79e2a6bbd53-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:44:04 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:44:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Flow 'volume_create_manager' (3fb22785-a989-4156-a21c-99d671c15d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:44:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c660bf92-3196-4b39-bd20-cc2ad3b3e1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c660bf92-3196-4b39-bd20-cc2ad3b3e1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1500880915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40cd9d4c-b2c9-442e-872a-7f81b9f5fb94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aa0342413c24691af6118273dffc362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:44:05Z,use_quota=True,user_id='89b96b1946754b07a51d62dd91235f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c7afa07-c43f-4292-a979-bfa81fe0c442),volume_type_id=6c7afa07-c43f-4292-a979-bfa81fe0c442)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5021dd8d-0b9a-432c-bb3a-4453ad1a1a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5021dd8d-0b9a-432c-bb3a-4453ad1a1a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72140979-ffb6-4281-b57b-7eb5d2a8cd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72140979-ffb6-4281-b57b-7eb5d2a8cd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40cd9d4c-b2c9-442e-872a-7f81b9f5fb94', 'volume_name': 'volume-40cd9d4c-b2c9-442e-872a-7f81b9f5fb94', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4850c235-2949-4f35-a17d-0a72ff9dedf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4850c235-2949-4f35-a17d-0a72ff9dedf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4918ef5-2a46-4335-9061-85c8c2cd5c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:04 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Volume 40cd9d4c-b2c9-442e-872a-7f81b9f5fb94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40cd9d4c-b2c9-442e-872a-7f81b9f5fb94', 'volume_size': 1} Apr 29 06:44:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1500880915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40cd9d4c-b2c9-442e-872a-7f81b9f5fb94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aa0342413c24691af6118273dffc362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:44:05Z,use_quota=True,user_id='89b96b1946754b07a51d62dd91235f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c7afa07-c43f-4292-a979-bfa81fe0c442),volume_type_id=6c7afa07-c43f-4292-a979-bfa81fe0c442)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:44:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Creating volume 40cd9d4c-b2c9-442e-872a-7f81b9f5fb94 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:44:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:44:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:44:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:44:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:44:04 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:44:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-40cd9d4c-b2c9-442e-872a-7f81b9f5fb94 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:04 devstack sudo[91171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-40cd9d4c-b2c9-442e-872a-7f81b9f5fb94 1073741824 Apr 29 06:44:04 devstack sudo[91171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:05 devstack sudo[91171]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-40cd9d4c-b2c9-442e-872a-7f81b9f5fb94 1073741824" returned: 0 in 0.990s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-40cd9d4c-b2c9-442e-872a-7f81b9f5fb94 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:05 devstack sudo[91177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-40cd9d4c-b2c9-442e-872a-7f81b9f5fb94 Apr 29 06:44:05 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:06 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-40cd9d4c-b2c9-442e-872a-7f81b9f5fb94" returned: 0 in 0.679s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:06 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:44:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:44:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4918ef5-2a46-4335-9061-85c8c2cd5c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40cd9d4c-b2c9-442e-872a-7f81b9f5fb94', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f4b5e18-0dfe-4f97-ba34-8041d037c741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:06 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Volume volume-40cd9d4c-b2c9-442e-872a-7f81b9f5fb94 (40cd9d4c-b2c9-442e-872a-7f81b9f5fb94): created successfully Apr 29 06:44:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f4b5e18-0dfe-4f97-ba34-8041d037c741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Flow 'volume_create_manager' (3fb22785-a989-4156-a21c-99d671c15d8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:44:06 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-57bfe911-42d7-411f-8ab6-d57a4b11faf2 tempest-VolumeTypesAccessTest-1546300483 None] Created volume successfully. Apr 29 06:44:06 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-816dcf81-f4c7-428f-982e-7dace9777945 tempest-VolumeTypesAccessTest-1546300483 None] Acquiring lock "cinder-40cd9d4c-b2c9-442e-872a-7f81b9f5fb94-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:44:06 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-816dcf81-f4c7-428f-982e-7dace9777945 tempest-VolumeTypesAccessTest-1546300483 None] Lock "cinder-40cd9d4c-b2c9-442e-872a-7f81b9f5fb94-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:44:06 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-816dcf81-f4c7-428f-982e-7dace9777945 tempest-VolumeTypesAccessTest-1546300483 None] Acquiring lock "cinder-quobyte-40cd9d4c-b2c9-442e-872a-7f81b9f5fb94" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:44:06 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-816dcf81-f4c7-428f-982e-7dace9777945 tempest-VolumeTypesAccessTest-1546300483 None] Lock "cinder-quobyte-40cd9d4c-b2c9-442e-872a-7f81b9f5fb94" acquired by "delete_volume" :: waited 0.016s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:44:07 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[1573e33a-0211-49bc-a46c-8963abde2868]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:44:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-816dcf81-f4c7-428f-982e-7dace9777945 tempest-VolumeTypesAccessTest-1546300483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-40cd9d4c-b2c9-442e-872a-7f81b9f5fb94 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:07 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-40cd9d4c-b2c9-442e-872a-7f81b9f5fb94 Apr 29 06:44:07 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:07 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-816dcf81-f4c7-428f-982e-7dace9777945 tempest-VolumeTypesAccessTest-1546300483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-40cd9d4c-b2c9-442e-872a-7f81b9f5fb94" returned: 0 in 0.840s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-816dcf81-f4c7-428f-982e-7dace9777945 tempest-VolumeTypesAccessTest-1546300483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-40cd9d4c-b2c9-442e-872a-7f81b9f5fb94 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:07 devstack sudo[91186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-40cd9d4c-b2c9-442e-872a-7f81b9f5fb94 Apr 29 06:44:07 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:08 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-816dcf81-f4c7-428f-982e-7dace9777945 tempest-VolumeTypesAccessTest-1546300483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-40cd9d4c-b2c9-442e-872a-7f81b9f5fb94" returned: 0 in 0.699s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:08 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-816dcf81-f4c7-428f-982e-7dace9777945 tempest-VolumeTypesAccessTest-1546300483 None] Lock "cinder-quobyte-40cd9d4c-b2c9-442e-872a-7f81b9f5fb94" released by "delete_volume" :: held 1.588s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:44:08 devstack cinder-volume[84195]: WARNING cinder.quota [None req-816dcf81-f4c7-428f-982e-7dace9777945 tempest-VolumeTypesAccessTest-1546300483 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1021241648 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1021241648, it is now deprecated. Please use the default quota class for default quota. Apr 29 06:44:08 devstack cinder-volume[84195]: WARNING cinder.quota [None req-816dcf81-f4c7-428f-982e-7dace9777945 tempest-VolumeTypesAccessTest-1546300483 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1021241648 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1021241648, it is now deprecated. Please use the default quota class for default quota. Apr 29 06:44:08 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-816dcf81-f4c7-428f-982e-7dace9777945 tempest-VolumeTypesAccessTest-1546300483 None] Created reservations ['0f56fa04-bb10-4ad2-a81e-fe3edd58072b', '47466161-1a95-4a05-af2b-c3248568fb0b', '8a6fdf3b-0e26-4436-9650-bb30484a2beb', '5cb12152-ade8-467d-a3f2-82c0c2d67c3d'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:44:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-816dcf81-f4c7-428f-982e-7dace9777945 tempest-VolumeTypesAccessTest-1546300483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-816dcf81-f4c7-428f-982e-7dace9777945 tempest-VolumeTypesAccessTest-1546300483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-816dcf81-f4c7-428f-982e-7dace9777945 tempest-VolumeTypesAccessTest-1546300483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:44:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-816dcf81-f4c7-428f-982e-7dace9777945 tempest-VolumeTypesAccessTest-1546300483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:44:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-816dcf81-f4c7-428f-982e-7dace9777945 tempest-VolumeTypesAccessTest-1546300483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:44:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-816dcf81-f4c7-428f-982e-7dace9777945 tempest-VolumeTypesAccessTest-1546300483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:08 devstack sudo[91189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:44:08 devstack sudo[91189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:09 devstack sudo[91189]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-816dcf81-f4c7-428f-982e-7dace9777945 tempest-VolumeTypesAccessTest-1546300483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.777s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:09 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-816dcf81-f4c7-428f-982e-7dace9777945 tempest-VolumeTypesAccessTest-1546300483 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:44:09 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-816dcf81-f4c7-428f-982e-7dace9777945 tempest-VolumeTypesAccessTest-1546300483 None] Deleted volume successfully. Apr 29 06:44:09 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-816dcf81-f4c7-428f-982e-7dace9777945 tempest-VolumeTypesAccessTest-1546300483 None] Lock "cinder-40cd9d4c-b2c9-442e-872a-7f81b9f5fb94-delete_volume" released by "delete_volume" :: held 2.642s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:44:13 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:44:13 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Flow 'volume_create_manager' (89e04d82-65ac-478e-bda0-c35c3ebaeba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:44:13 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bfc1d13-0954-4561-a980-15a80f7363a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:13 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bfc1d13-0954-4561-a980-15a80f7363a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-264986050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b02ff18-6062-4b7f-83cb-26e68233f5b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e37e8c2a947444f9c90642a08cfb2fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:44:14Z,use_quota=True,user_id='fb914768d2944715bbeff26f818adc68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:13 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b9e6ca-fa4c-4fd6-81ca-bce421e33f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:13 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b9e6ca-fa4c-4fd6-81ca-bce421e33f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:13 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff01e3f-e6f9-4d0f-8a12-97a0e86211f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:13 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff01e3f-e6f9-4d0f-8a12-97a0e86211f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b02ff18-6062-4b7f-83cb-26e68233f5b3', 'volume_name': 'volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:13 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc41c15-48db-4ab3-90f2-042daceba433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:13 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc41c15-48db-4ab3-90f2-042daceba433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:13 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca6971b7-a82b-45ed-bfcc-a05c77863d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:13 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Volume 6b02ff18-6062-4b7f-83cb-26e68233f5b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3', 'volume_size': 1} Apr 29 06:44:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:13 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-264986050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b02ff18-6062-4b7f-83cb-26e68233f5b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e37e8c2a947444f9c90642a08cfb2fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:44:14Z,use_quota=True,user_id='fb914768d2944715bbeff26f818adc68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:44:13 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Creating volume 6b02ff18-6062-4b7f-83cb-26e68233f5b3 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:44:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:13 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:44:13 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:44:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:44:13 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:44:13 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:44:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:13 devstack sudo[91192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3 1073741824 Apr 29 06:44:13 devstack sudo[91192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:14 devstack sudo[91192]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3 1073741824" returned: 0 in 0.881s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:14 devstack sudo[91198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3 Apr 29 06:44:14 devstack sudo[91198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:15 devstack sudo[91198]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3" returned: 0 in 0.630s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:15 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:44:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:44:15 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca6971b7-a82b-45ed-bfcc-a05c77863d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:15 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2927e0b9-77f2-47cc-bb45-e0ea8ef74117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:15 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Volume volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3 (6b02ff18-6062-4b7f-83cb-26e68233f5b3): created successfully Apr 29 06:44:15 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2927e0b9-77f2-47cc-bb45-e0ea8ef74117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:15 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Flow 'volume_create_manager' (89e04d82-65ac-478e-bda0-c35c3ebaeba0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:44:15 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-f0221cd6-1c0c-46e0-b6c6-400a82362379 tempest-VolumesSnapshotTestJSON-917607631 None] Created volume successfully. Apr 29 06:44:16 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:SELECT=132,cinder:UPDATE=145,cinder:DELETE=11,cinder:INSERT=36 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:44:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1083a790-fa9f-49a4-9fd9-5f020e0e4d94 tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1083a790-fa9f-49a4-9fd9-5f020e0e4d94 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:16 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-1083a790-fa9f-49a4-9fd9-5f020e0e4d94 tempest-VolumesSnapshotTestJSON-917607631 None] Creating offline snapshot cdc6816a-74b9-402f-98a8-ec4880dc9edb of volume 6b02ff18-6062-4b7f-83cb-26e68233f5b3 {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:44:16 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b6ba15-10c5-4902-9502-e885fcc2cd14]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:44:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1083a790-fa9f-49a4-9fd9-5f020e0e4d94 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:16 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3 Apr 29 06:44:16 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:17 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:SELECT=119,cinder:UPDATE=158,cinder:INSERT=32,cinder:DELETE=6 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:44:17 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:44:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Flow 'volume_create_manager' (0e5a8c35-a022-44ee-8cc1-49b12073d3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:44:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702db53a-f7a8-4727-8671-746484317e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702db53a-f7a8-4727-8671-746484317e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2111159868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eaf245e-99a5-4faf-980b-e8dbdc579345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10c140d165ca4e08b5af34f4c9094914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:44:17Z,use_quota=True,user_id='5602e47564d547738f03222c1329f31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a718b60a-00f3-41d2-b9e2-d9ec54292ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a718b60a-00f3-41d2-b9e2-d9ec54292ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ce0bef-9e18-45da-92f5-f89d56b145ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ce0bef-9e18-45da-92f5-f89d56b145ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eaf245e-99a5-4faf-980b-e8dbdc579345', 'volume_name': 'volume-1eaf245e-99a5-4faf-980b-e8dbdc579345', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6e4429-8ba4-426d-987a-a4334445a55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6e4429-8ba4-426d-987a-a4334445a55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:17 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41d4105-b3f7-4488-a9a0-bf29b419cfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:17 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Volume 1eaf245e-99a5-4faf-980b-e8dbdc579345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eaf245e-99a5-4faf-980b-e8dbdc579345', 'volume_size': 1} Apr 29 06:44:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1083a790-fa9f-49a4-9fd9-5f020e0e4d94 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3" returned: 0 in 0.963s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1083a790-fa9f-49a4-9fd9-5f020e0e4d94 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3.cdc6816a-74b9-402f-98a8-ec4880dc9edb 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:17 devstack sudo[91210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3.cdc6816a-74b9-402f-98a8-ec4880dc9edb 1G Apr 29 06:44:17 devstack sudo[91210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:18 devstack sudo[91210]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1083a790-fa9f-49a4-9fd9-5f020e0e4d94 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3.cdc6816a-74b9-402f-98a8-ec4880dc9edb 1G" returned: 0 in 0.831s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1083a790-fa9f-49a4-9fd9-5f020e0e4d94 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3.cdc6816a-74b9-402f-98a8-ec4880dc9edb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:18 devstack sudo[91216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3.cdc6816a-74b9-402f-98a8-ec4880dc9edb Apr 29 06:44:18 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:18 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1083a790-fa9f-49a4-9fd9-5f020e0e4d94 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3.cdc6816a-74b9-402f-98a8-ec4880dc9edb" returned: 0 in 0.699s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:18 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-1083a790-fa9f-49a4-9fd9-5f020e0e4d94 tempest-VolumesSnapshotTestJSON-917607631 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3.cdc6816a-74b9-402f-98a8-ec4880dc9edb is being set with open permissions: ugo+rw Apr 29 06:44:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1083a790-fa9f-49a4-9fd9-5f020e0e4d94 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3.cdc6816a-74b9-402f-98a8-ec4880dc9edb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:18 devstack sudo[91226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3.cdc6816a-74b9-402f-98a8-ec4880dc9edb Apr 29 06:44:18 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:19 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1083a790-fa9f-49a4-9fd9-5f020e0e4d94 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3.cdc6816a-74b9-402f-98a8-ec4880dc9edb" returned: 0 in 0.658s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1083a790-fa9f-49a4-9fd9-5f020e0e4d94 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:19 devstack sudo[91230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3.info Apr 29 06:44:19 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:20 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1083a790-fa9f-49a4-9fd9-5f020e0e4d94 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3.info" returned: 0 in 0.635s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:20 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-1083a790-fa9f-49a4-9fd9-5f020e0e4d94 tempest-VolumesSnapshotTestJSON-917607631 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3.info is being set with open permissions: ugo+rw Apr 29 06:44:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1083a790-fa9f-49a4-9fd9-5f020e0e4d94 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:20 devstack sudo[91233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3.info Apr 29 06:44:20 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:20 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1083a790-fa9f-49a4-9fd9-5f020e0e4d94 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3.info" returned: 0 in 0.631s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1083a790-fa9f-49a4-9fd9-5f020e0e4d94 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.530s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:44:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.527s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2111159868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eaf245e-99a5-4faf-980b-e8dbdc579345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10c140d165ca4e08b5af34f4c9094914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:44:17Z,use_quota=True,user_id='5602e47564d547738f03222c1329f31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:44:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Creating volume 1eaf245e-99a5-4faf-980b-e8dbdc579345 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:44:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:44:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:44:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:44:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:44:20 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:44:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1eaf245e-99a5-4faf-980b-e8dbdc579345 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:20 devstack sudo[91236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1eaf245e-99a5-4faf-980b-e8dbdc579345 1073741824 Apr 29 06:44:20 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:20 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-1083a790-fa9f-49a4-9fd9-5f020e0e4d94 tempest-VolumesSnapshotTestJSON-917607631 None] Create snapshot completed successfully Apr 29 06:44:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c3b9cbdb-c24e-4614-bd9d-5614767296a8 tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "cinder-cdc6816a-74b9-402f-98a8-ec4880dc9edb-delete_snapshot" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:44:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c3b9cbdb-c24e-4614-bd9d-5614767296a8 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-cdc6816a-74b9-402f-98a8-ec4880dc9edb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:44:21 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1eaf245e-99a5-4faf-980b-e8dbdc579345 1073741824" returned: 0 in 0.930s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c3b9cbdb-c24e-4614-bd9d-5614767296a8 tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "cinder-quobyte-6b02ff18-6062-4b7f-83cb-26e68233f5b3" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:44:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c3b9cbdb-c24e-4614-bd9d-5614767296a8 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-6b02ff18-6062-4b7f-83cb-26e68233f5b3" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:44:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c3b9cbdb-c24e-4614-bd9d-5614767296a8 tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "cinder-quobyte-cdc6816a-74b9-402f-98a8-ec4880dc9edb" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:44:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c3b9cbdb-c24e-4614-bd9d-5614767296a8 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-cdc6816a-74b9-402f-98a8-ec4880dc9edb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:44:21 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-c3b9cbdb-c24e-4614-bd9d-5614767296a8 tempest-VolumesSnapshotTestJSON-917607631 None] Deleting offline snapshot cdc6816a-74b9-402f-98a8-ec4880dc9edb of volume 6b02ff18-6062-4b7f-83cb-26e68233f5b3 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:44:21 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-c3b9cbdb-c24e-4614-bd9d-5614767296a8 tempest-VolumesSnapshotTestJSON-917607631 None] snapshot_file for this snap is: volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3.cdc6816a-74b9-402f-98a8-ec4880dc9edb {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:44:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1eaf245e-99a5-4faf-980b-e8dbdc579345 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:21 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[153e7324-173a-49ca-aa4f-cce722d0a0a1]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:44:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c3b9cbdb-c24e-4614-bd9d-5614767296a8 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3.cdc6816a-74b9-402f-98a8-ec4880dc9edb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:21 devstack sudo[91242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1eaf245e-99a5-4faf-980b-e8dbdc579345 Apr 29 06:44:21 devstack sudo[91242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:22 devstack sudo[91243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3.cdc6816a-74b9-402f-98a8-ec4880dc9edb Apr 29 06:44:22 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:22 devstack sudo[91242]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1eaf245e-99a5-4faf-980b-e8dbdc579345" returned: 0 in 0.672s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:44:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:44:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41d4105-b3f7-4488-a9a0-bf29b419cfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eaf245e-99a5-4faf-980b-e8dbdc579345', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (894fdfa3-65a9-4086-9958-a1b272e9bb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:22 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Volume volume-1eaf245e-99a5-4faf-980b-e8dbdc579345 (1eaf245e-99a5-4faf-980b-e8dbdc579345): created successfully Apr 29 06:44:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (894fdfa3-65a9-4086-9958-a1b272e9bb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Flow 'volume_create_manager' (0e5a8c35-a022-44ee-8cc1-49b12073d3bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:44:22 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-318310fd-c961-4c2d-92ad-a287c573aafa tempest-VolumesTransfersV355Test-110532971 None] Created volume successfully. Apr 29 06:44:22 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c3b9cbdb-c24e-4614-bd9d-5614767296a8 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3.cdc6816a-74b9-402f-98a8-ec4880dc9edb" returned: 0 in 0.812s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-c3b9cbdb-c24e-4614-bd9d-5614767296a8 tempest-VolumesSnapshotTestJSON-917607631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:44:22 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c43f9c-d1bc-4b46-9f84-11e1ab04df0d]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:44:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c3b9cbdb-c24e-4614-bd9d-5614767296a8 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:22 devstack sudo[91250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3 Apr 29 06:44:22 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:23 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c3b9cbdb-c24e-4614-bd9d-5614767296a8 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3" returned: 0 in 0.735s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c3b9cbdb-c24e-4614-bd9d-5614767296a8 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3.cdc6816a-74b9-402f-98a8-ec4880dc9edb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:23 devstack sudo[91255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3.cdc6816a-74b9-402f-98a8-ec4880dc9edb Apr 29 06:44:23 devstack sudo[91255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:24 devstack sudo[91255]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c3b9cbdb-c24e-4614-bd9d-5614767296a8 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3.cdc6816a-74b9-402f-98a8-ec4880dc9edb" returned: 0 in 0.801s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c3b9cbdb-c24e-4614-bd9d-5614767296a8 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3.cdc6816a-74b9-402f-98a8-ec4880dc9edb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:24 devstack sudo[91271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3.cdc6816a-74b9-402f-98a8-ec4880dc9edb Apr 29 06:44:24 devstack sudo[91271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:24 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-7ef44803-9f5d-419c-a3e4-a79793f183dc tempest-VolumesTransfersV355Test-1314745507 None] Transfer volume completed successfully. Apr 29 06:44:25 devstack sudo[91271]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c3b9cbdb-c24e-4614-bd9d-5614767296a8 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3.cdc6816a-74b9-402f-98a8-ec4880dc9edb" returned: 0 in 0.743s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:25 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c3b9cbdb-c24e-4614-bd9d-5614767296a8 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-cdc6816a-74b9-402f-98a8-ec4880dc9edb" released by "_delete_snapshot" :: held 3.231s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:44:25 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c3b9cbdb-c24e-4614-bd9d-5614767296a8 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-6b02ff18-6062-4b7f-83cb-26e68233f5b3" released by "delete_snapshot" :: held 3.262s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:44:25 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-c3b9cbdb-c24e-4614-bd9d-5614767296a8 tempest-VolumesSnapshotTestJSON-917607631 None] Created reservations ['03e9fdd0-80e8-4a10-b561-2985c98f9a51', '12ca3f71-8b69-4429-8f3e-b14e8daebebd', '5f923421-7295-4fb3-a751-07e14d53fb98', '1dc19e79-e7e1-424e-8216-bad19e271785'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:44:25 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-c3b9cbdb-c24e-4614-bd9d-5614767296a8 tempest-VolumesSnapshotTestJSON-917607631 None] Delete snapshot completed successfully. Apr 29 06:44:25 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c3b9cbdb-c24e-4614-bd9d-5614767296a8 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-cdc6816a-74b9-402f-98a8-ec4880dc9edb-delete_snapshot" released by "delete_snapshot" :: held 3.479s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:44:25 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f363ed8c-5897-4938-adeb-d04cab3d17bc tempest-VolumesTransfersV355Test-661146574 None] Acquiring lock "cinder-1eaf245e-99a5-4faf-980b-e8dbdc579345-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:44:25 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f363ed8c-5897-4938-adeb-d04cab3d17bc tempest-VolumesTransfersV355Test-661146574 None] Lock "cinder-1eaf245e-99a5-4faf-980b-e8dbdc579345-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:44:25 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f363ed8c-5897-4938-adeb-d04cab3d17bc tempest-VolumesTransfersV355Test-661146574 None] Acquiring lock "cinder-quobyte-1eaf245e-99a5-4faf-980b-e8dbdc579345" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:44:25 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f363ed8c-5897-4938-adeb-d04cab3d17bc tempest-VolumesTransfersV355Test-661146574 None] Lock "cinder-quobyte-1eaf245e-99a5-4faf-980b-e8dbdc579345" acquired by "delete_volume" :: waited 0.015s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:44:25 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae940a8a-4760-462b-8212-22c6e7dd7687]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:44:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f363ed8c-5897-4938-adeb-d04cab3d17bc tempest-VolumesTransfersV355Test-661146574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1eaf245e-99a5-4faf-980b-e8dbdc579345 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:25 devstack sudo[91299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1eaf245e-99a5-4faf-980b-e8dbdc579345 Apr 29 06:44:25 devstack sudo[91299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:26 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:44:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Flow 'volume_create_manager' (a07e614d-e407-40c1-b765-c8fc832d17a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:44:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28f991cc-22f7-451b-80e3-2287375ef28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:26 devstack sudo[91299]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28f991cc-22f7-451b-80e3-2287375ef28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1583124070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790d7a32-0854-4bba-bc6a-3f62fb474ecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e37e8c2a947444f9c90642a08cfb2fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:44:26Z,use_quota=True,user_id='fb914768d2944715bbeff26f818adc68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51bf4bd2-9fad-4e98-ae4a-0748ebed3464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51bf4bd2-9fad-4e98-ae4a-0748ebed3464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b691779-981e-4c89-95e9-1ac85a6ef0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b691779-981e-4c89-95e9-1ac85a6ef0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '790d7a32-0854-4bba-bc6a-3f62fb474ecb', 'volume_name': 'volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a566c1a5-5232-479a-be45-ada8e297e668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a566c1a5-5232-479a-be45-ada8e297e668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f804bf7-46ef-44a5-9260-635929b07ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:26 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Volume 790d7a32-0854-4bba-bc6a-3f62fb474ecb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb', 'volume_size': 1} Apr 29 06:44:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:26 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1583124070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790d7a32-0854-4bba-bc6a-3f62fb474ecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e37e8c2a947444f9c90642a08cfb2fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:44:26Z,use_quota=True,user_id='fb914768d2944715bbeff26f818adc68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:44:26 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Creating volume 790d7a32-0854-4bba-bc6a-3f62fb474ecb {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:44:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:26 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:44:26 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:44:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:44:26 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:44:26 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:44:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f363ed8c-5897-4938-adeb-d04cab3d17bc tempest-VolumesTransfersV355Test-661146574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1eaf245e-99a5-4faf-980b-e8dbdc579345" returned: 0 in 0.907s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f363ed8c-5897-4938-adeb-d04cab3d17bc tempest-VolumesTransfersV355Test-661146574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1eaf245e-99a5-4faf-980b-e8dbdc579345 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:26 devstack sudo[91305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb 1073741824 Apr 29 06:44:26 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:26 devstack sudo[91306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1eaf245e-99a5-4faf-980b-e8dbdc579345 Apr 29 06:44:26 devstack sudo[91306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:27 devstack sudo[91306]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f363ed8c-5897-4938-adeb-d04cab3d17bc tempest-VolumesTransfersV355Test-661146574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1eaf245e-99a5-4faf-980b-e8dbdc579345" returned: 0 in 0.681s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:27 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f363ed8c-5897-4938-adeb-d04cab3d17bc tempest-VolumesTransfersV355Test-661146574 None] Lock "cinder-quobyte-1eaf245e-99a5-4faf-980b-e8dbdc579345" released by "delete_volume" :: held 1.629s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:44:27 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-f363ed8c-5897-4938-adeb-d04cab3d17bc tempest-VolumesTransfersV355Test-661146574 None] Created reservations ['d6b8a131-06de-43b0-96c3-97a1fce48401', '433968f8-73b7-4748-86b3-fc4602477a90', '7e52151a-28f5-43fc-a362-a93d8499d76c', '0d7569b1-107e-403d-8a01-f6babe9ad772'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:44:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f363ed8c-5897-4938-adeb-d04cab3d17bc tempest-VolumesTransfersV355Test-661146574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f363ed8c-5897-4938-adeb-d04cab3d17bc tempest-VolumesTransfersV355Test-661146574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:27 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f363ed8c-5897-4938-adeb-d04cab3d17bc tempest-VolumesTransfersV355Test-661146574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:44:27 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f363ed8c-5897-4938-adeb-d04cab3d17bc tempest-VolumesTransfersV355Test-661146574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:44:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f363ed8c-5897-4938-adeb-d04cab3d17bc tempest-VolumesTransfersV355Test-661146574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:44:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f363ed8c-5897-4938-adeb-d04cab3d17bc tempest-VolumesTransfersV355Test-661146574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:27 devstack sudo[91314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:44:27 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:27 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb 1073741824" returned: 0 in 0.941s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:27 devstack sudo[91316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb Apr 29 06:44:27 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:28 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f363ed8c-5897-4938-adeb-d04cab3d17bc tempest-VolumesTransfersV355Test-661146574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.693s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-f363ed8c-5897-4938-adeb-d04cab3d17bc tempest-VolumesTransfersV355Test-661146574 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:44:28 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-f363ed8c-5897-4938-adeb-d04cab3d17bc tempest-VolumesTransfersV355Test-661146574 None] Deleted volume successfully. Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f363ed8c-5897-4938-adeb-d04cab3d17bc tempest-VolumesTransfersV355Test-661146574 None] Lock "cinder-1eaf245e-99a5-4faf-980b-e8dbdc579345-delete_volume" released by "delete_volume" :: held 2.575s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:44:28 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb" returned: 0 in 0.746s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f804bf7-46ef-44a5-9260-635929b07ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53fb415b-a5ea-4a1e-8212-9c622c82c70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:28 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Volume volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb (790d7a32-0854-4bba-bc6a-3f62fb474ecb): created successfully Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53fb415b-a5ea-4a1e-8212-9c622c82c70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Flow 'volume_create_manager' (a07e614d-e407-40c1-b765-c8fc832d17a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Flow 'volume_create_manager' (c08e3c62-29ca-4e79-9b78-14218f9d5525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7918380-9544-465d-9ba7-55103e8f38c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:28 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-3c3cf071-cbf3-4577-9fed-a56fe8252d1c tempest-VolumesSnapshotTestJSON-917607631 None] Created volume successfully. Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7918380-9544-465d-9ba7-55103e8f38c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-475911160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26a6e84-088e-4c17-8d67-e58515fecfdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10c140d165ca4e08b5af34f4c9094914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:44:28Z,use_quota=True,user_id='5602e47564d547738f03222c1329f31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e98e034-486f-4ec3-b855-c8501ea10678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e98e034-486f-4ec3-b855-c8501ea10678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7afd97f6-20c1-4c22-bd2a-4b1828710abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7afd97f6-20c1-4c22-bd2a-4b1828710abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a26a6e84-088e-4c17-8d67-e58515fecfdf', 'volume_name': 'volume-a26a6e84-088e-4c17-8d67-e58515fecfdf', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d69d8c1-977d-4a46-beb6-aa5edaff37bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d69d8c1-977d-4a46-beb6-aa5edaff37bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b78271-b7ce-4289-ac6d-fe90296cc0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:28 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Volume a26a6e84-088e-4c17-8d67-e58515fecfdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a26a6e84-088e-4c17-8d67-e58515fecfdf', 'volume_size': 1} Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-475911160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26a6e84-088e-4c17-8d67-e58515fecfdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10c140d165ca4e08b5af34f4c9094914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:44:28Z,use_quota=True,user_id='5602e47564d547738f03222c1329f31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Creating volume a26a6e84-088e-4c17-8d67-e58515fecfdf {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:44:28 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a26a6e84-088e-4c17-8d67-e58515fecfdf 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:28 devstack sudo[91320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a26a6e84-088e-4c17-8d67-e58515fecfdf 1073741824 Apr 29 06:44:28 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-69529b17-3519-48c4-831e-3e7f4118231b tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:29 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a26a6e84-088e-4c17-8d67-e58515fecfdf 1073741824" returned: 0 in 0.870s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a26a6e84-088e-4c17-8d67-e58515fecfdf {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:29 devstack sudo[91326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a26a6e84-088e-4c17-8d67-e58515fecfdf Apr 29 06:44:29 devstack sudo[91326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:29 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:44:29 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Flow 'volume_create_manager' (f27853d1-380c-4374-b65b-445142e2b88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:44:29 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3125a9c1-9404-48d5-a9e5-27915df0af82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:29 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3125a9c1-9404-48d5-a9e5-27915df0af82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-925042693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fa0cd30-2b30-4dcb-8173-c8f3200a33ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b81602e2b1f346df857e140fac7997e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:44:30Z,use_quota=True,user_id='06cc891a9531440bbb8284f270dc9596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:29 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05a24fc-5968-48e2-a4b9-496bf79d3f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:29 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05a24fc-5968-48e2-a4b9-496bf79d3f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:29 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d5d89f4-282f-4501-aad6-14ee2dbc6c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:29 devstack cinder-volume[84195]: DEBUG cinder.image.glance [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Creating Keystone auth plugin from conf {{(pid=84195) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 06:44:29 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d5d89f4-282f-4501-aad6-14ee2dbc6c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0fa0cd30-2b30-4dcb-8173-c8f3200a33ae', 'volume_name': 'volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae', 'volume_size': 1, 'image_id': '3c917343-78b7-403b-853d-4aeabac3edf1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c917343-78b7-403b-853d-4aeabac3edf1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0b2d77ae633e436aa18dac7e4fad942b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c917343-78b7-403b-853d-4aeabac3edf1', 'created_at': datetime.datetime(2026, 4, 29, 4, 32, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 4, 32, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c917343-78b7-403b-853d-4aeabac3edf1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:29 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f549e918-7eeb-4d31-acc2-094f92e04ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:29 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f549e918-7eeb-4d31-acc2-094f92e04ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:29 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cac0c20-0048-4b30-9cc1-179f013f38cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:29 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Volume 0fa0cd30-2b30-4dcb-8173-c8f3200a33ae: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae', 'volume_size': 1, 'image_id': '3c917343-78b7-403b-853d-4aeabac3edf1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c917343-78b7-403b-853d-4aeabac3edf1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0b2d77ae633e436aa18dac7e4fad942b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c917343-78b7-403b-853d-4aeabac3edf1', 'created_at': datetime.datetime(2026, 4, 29, 4, 32, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 4, 32, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c917343-78b7-403b-853d-4aeabac3edf1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 06:44:29 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Trying to clone 0fa0cd30-2b30-4dcb-8173-c8f3200a33ae from image 3c917343-78b7-403b-853d-4aeabac3edf1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3c917343-78b7-403b-853d-4aeabac3edf1', 'metadata': {}}]). {{(pid=84195) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 29 06:44:30 devstack sudo[91326]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a26a6e84-088e-4c17-8d67-e58515fecfdf" returned: 0 in 0.670s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:30 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:44:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:44:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-69529b17-3519-48c4-831e-3e7f4118231b tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.223s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:30 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b78271-b7ce-4289-ac6d-fe90296cc0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a26a6e84-088e-4c17-8d67-e58515fecfdf', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:30 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9469894-c9a2-4c8b-a462-7d11bea29361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:30 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-69529b17-3519-48c4-831e-3e7f4118231b tempest-VolumesSnapshotTestJSON-917607631 None] Creating offline snapshot fc2e734e-7a59-40c5-8ddb-b051b4bd48ae of volume 790d7a32-0854-4bba-bc6a-3f62fb474ecb {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:44:30 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Volume volume-a26a6e84-088e-4c17-8d67-e58515fecfdf (a26a6e84-088e-4c17-8d67-e58515fecfdf): created successfully Apr 29 06:44:30 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9469894-c9a2-4c8b-a462-7d11bea29361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:30 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Flow 'volume_create_manager' (c08e3c62-29ca-4e79-9b78-14218f9d5525) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:44:30 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b42088-3a9c-4e74-a991-de9de554e3ba]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:44:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-69529b17-3519-48c4-831e-3e7f4118231b tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:30 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_dt3ugafkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84195) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 06:44:30 devstack cinder-volume[84195]: INFO cinder.image.image_utils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Image download 20.69 MB at 20.69 MB/s Apr 29 06:44:30 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-35888a9a-c715-4f73-9631-7e3bb562ba99 tempest-VolumesTransfersV355Test-110532971 None] Created volume successfully. Apr 29 06:44:30 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[073e2f47-80fe-4043-8770-595fd5d1a677]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:44:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_dt3ugafkdevstack@QuobyteHD {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:30 devstack sudo[91330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb Apr 29 06:44:30 devstack sudo[91330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:30 devstack sudo[91331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_dt3ugafkdevstack@QuobyteHD Apr 29 06:44:30 devstack sudo[91331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:30 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2f4fb4cf-88e1-4938-905b-ad696447a544 tempest-VolumesTransfersV355Test-661146574 None] Acquiring lock "cinder-a26a6e84-088e-4c17-8d67-e58515fecfdf-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:44:30 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2f4fb4cf-88e1-4938-905b-ad696447a544 tempest-VolumesTransfersV355Test-661146574 None] Lock "cinder-a26a6e84-088e-4c17-8d67-e58515fecfdf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:44:30 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2f4fb4cf-88e1-4938-905b-ad696447a544 tempest-VolumesTransfersV355Test-661146574 None] Acquiring lock "cinder-quobyte-a26a6e84-088e-4c17-8d67-e58515fecfdf" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:44:30 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2f4fb4cf-88e1-4938-905b-ad696447a544 tempest-VolumesTransfersV355Test-661146574 None] Lock "cinder-quobyte-a26a6e84-088e-4c17-8d67-e58515fecfdf" acquired by "delete_volume" :: waited 0.016s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:44:30 devstack sudo[91330]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-69529b17-3519-48c4-831e-3e7f4118231b tempest-VolumesSnapshotTestJSON-917607631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb" returned: 0 in 0.785s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-69529b17-3519-48c4-831e-3e7f4118231b tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.fc2e734e-7a59-40c5-8ddb-b051b4bd48ae 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:31 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[a762b822-b5fe-4c93-9796-632455fa2736]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:44:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2f4fb4cf-88e1-4938-905b-ad696447a544 tempest-VolumesTransfersV355Test-661146574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a26a6e84-088e-4c17-8d67-e58515fecfdf {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:31 devstack sudo[91340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.fc2e734e-7a59-40c5-8ddb-b051b4bd48ae 1G Apr 29 06:44:31 devstack sudo[91340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:31 devstack sudo[91331]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_dt3ugafkdevstack@QuobyteHD" returned: 0 in 0.794s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:31 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Temporary image 3c917343-78b7-403b-853d-4aeabac3edf1 is fetched for user 06cc891a9531440bbb8284f270dc9596. {{(pid=84195) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 06:44:31 devstack sudo[91341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a26a6e84-088e-4c17-8d67-e58515fecfdf Apr 29 06:44:31 devstack sudo[91341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:31 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[744553f5-b44f-44ef-b250-b48a1d1e410b]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:44:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_dt3ugafkdevstack@QuobyteHD {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:31 devstack sudo[91344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_dt3ugafkdevstack@QuobyteHD Apr 29 06:44:31 devstack sudo[91344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:31 devstack sudo[91341]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2f4fb4cf-88e1-4938-905b-ad696447a544 tempest-VolumesTransfersV355Test-661146574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a26a6e84-088e-4c17-8d67-e58515fecfdf" returned: 0 in 0.773s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2f4fb4cf-88e1-4938-905b-ad696447a544 tempest-VolumesTransfersV355Test-661146574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a26a6e84-088e-4c17-8d67-e58515fecfdf {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:31 devstack sudo[91340]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-69529b17-3519-48c4-831e-3e7f4118231b tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.fc2e734e-7a59-40c5-8ddb-b051b4bd48ae 1G" returned: 0 in 0.818s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:31 devstack sudo[91357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a26a6e84-088e-4c17-8d67-e58515fecfdf Apr 29 06:44:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-69529b17-3519-48c4-831e-3e7f4118231b tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.fc2e734e-7a59-40c5-8ddb-b051b4bd48ae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:31 devstack sudo[91357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:31 devstack sudo[91344]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_dt3ugafkdevstack@QuobyteHD" returned: 0 in 0.684s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:31 devstack sudo[91359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.fc2e734e-7a59-40c5-8ddb-b051b4bd48ae Apr 29 06:44:31 devstack sudo[91359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:32 devstack sudo[91357]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2f4fb4cf-88e1-4938-905b-ad696447a544 tempest-VolumesTransfersV355Test-661146574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a26a6e84-088e-4c17-8d67-e58515fecfdf" returned: 0 in 0.611s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:32 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2f4fb4cf-88e1-4938-905b-ad696447a544 tempest-VolumesTransfersV355Test-661146574 None] Lock "cinder-quobyte-a26a6e84-088e-4c17-8d67-e58515fecfdf" released by "delete_volume" :: held 1.442s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:44:32 devstack sudo[91359]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-69529b17-3519-48c4-831e-3e7f4118231b tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.fc2e734e-7a59-40c5-8ddb-b051b4bd48ae" returned: 0 in 0.635s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:32 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-69529b17-3519-48c4-831e-3e7f4118231b tempest-VolumesSnapshotTestJSON-917607631 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.fc2e734e-7a59-40c5-8ddb-b051b4bd48ae is being set with open permissions: ugo+rw Apr 29 06:44:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-69529b17-3519-48c4-831e-3e7f4118231b tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.fc2e734e-7a59-40c5-8ddb-b051b4bd48ae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:32 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-2f4fb4cf-88e1-4938-905b-ad696447a544 tempest-VolumesTransfersV355Test-661146574 None] Created reservations ['cfe51371-c864-4163-9b90-c89be6e5af76', '632c5e62-13c0-4a7f-9f94-e93ecc71f791', '0308569a-6934-41d0-aac4-c2995f82c192', '3392e0f7-f88a-47d2-b943-0b837ec8dd17'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:44:32 devstack sudo[91371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.fc2e734e-7a59-40c5-8ddb-b051b4bd48ae Apr 29 06:44:32 devstack sudo[91371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2f4fb4cf-88e1-4938-905b-ad696447a544 tempest-VolumesTransfersV355Test-661146574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2f4fb4cf-88e1-4938-905b-ad696447a544 tempest-VolumesTransfersV355Test-661146574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:32 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2f4fb4cf-88e1-4938-905b-ad696447a544 tempest-VolumesTransfersV355Test-661146574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:44:32 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2f4fb4cf-88e1-4938-905b-ad696447a544 tempest-VolumesTransfersV355Test-661146574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:44:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2f4fb4cf-88e1-4938-905b-ad696447a544 tempest-VolumesTransfersV355Test-661146574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:44:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2f4fb4cf-88e1-4938-905b-ad696447a544 tempest-VolumesTransfersV355Test-661146574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:32 devstack sudo[91373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:44:32 devstack sudo[91373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:33 devstack sudo[91371]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-69529b17-3519-48c4-831e-3e7f4118231b tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.fc2e734e-7a59-40c5-8ddb-b051b4bd48ae" returned: 0 in 0.599s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-69529b17-3519-48c4-831e-3e7f4118231b tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:33 devstack sudo[91377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.info Apr 29 06:44:33 devstack sudo[91377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:33 devstack sudo[91373]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2f4fb4cf-88e1-4938-905b-ad696447a544 tempest-VolumesTransfersV355Test-661146574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.655s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:33 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-2f4fb4cf-88e1-4938-905b-ad696447a544 tempest-VolumesTransfersV355Test-661146574 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:44:33 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-2f4fb4cf-88e1-4938-905b-ad696447a544 tempest-VolumesTransfersV355Test-661146574 None] Deleted volume successfully. Apr 29 06:44:33 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2f4fb4cf-88e1-4938-905b-ad696447a544 tempest-VolumesTransfersV355Test-661146574 None] Lock "cinder-a26a6e84-088e-4c17-8d67-e58515fecfdf-delete_volume" released by "delete_volume" :: held 2.330s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:44:33 devstack sudo[91377]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-69529b17-3519-48c4-831e-3e7f4118231b tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.info" returned: 0 in 0.615s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:33 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-69529b17-3519-48c4-831e-3e7f4118231b tempest-VolumesSnapshotTestJSON-917607631 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.info is being set with open permissions: ugo+rw Apr 29 06:44:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-69529b17-3519-48c4-831e-3e7f4118231b tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:33 devstack sudo[91380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.info Apr 29 06:44:33 devstack sudo[91380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:34 devstack sudo[91380]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-69529b17-3519-48c4-831e-3e7f4118231b tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.info" returned: 0 in 0.606s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-69529b17-3519-48c4-831e-3e7f4118231b tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.207s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:44:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.518s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-925042693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fa0cd30-2b30-4dcb-8173-c8f3200a33ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b81602e2b1f346df857e140fac7997e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:44:30Z,use_quota=True,user_id='06cc891a9531440bbb8284f270dc9596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:44:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Creating volume 0fa0cd30-2b30-4dcb-8173-c8f3200a33ae {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:44:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:44:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:44:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:44:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:44:34 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:44:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:34 devstack sudo[91383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae 1073741824 Apr 29 06:44:34 devstack sudo[91383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:34 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-69529b17-3519-48c4-831e-3e7f4118231b tempest-VolumesSnapshotTestJSON-917607631 None] Create snapshot completed successfully Apr 29 06:44:35 devstack sudo[91383]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae 1073741824" returned: 0 in 0.870s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:35 devstack sudo[91390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae Apr 29 06:44:35 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:35 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:44:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Flow 'volume_create_manager' (d36782eb-5926-40a2-a95c-e40320ee0071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:44:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b6b7bc-72c1-47ed-b117-5659dd022a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b6b7bc-72c1-47ed-b117-5659dd022a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-803921522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203607db-3042-44f2-a0ce-542055ba0921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e37e8c2a947444f9c90642a08cfb2fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:44:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=fc2e734e-7a59-40c5-8ddb-b051b4bd48ae,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:44:36Z,use_quota=True,user_id='fb914768d2944715bbeff26f818adc68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6f32a88-243a-41ac-9cf9-1ae50c248432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6f32a88-243a-41ac-9cf9-1ae50c248432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3415d797-8e17-408c-bc67-f6b6a98e8039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3415d797-8e17-408c-bc67-f6b6a98e8039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '203607db-3042-44f2-a0ce-542055ba0921', 'volume_name': 'volume-203607db-3042-44f2-a0ce-542055ba0921', 'volume_size': 2, 'snapshot_id': 'fc2e734e-7a59-40c5-8ddb-b051b4bd48ae'}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0765e42f-e372-4a49-b764-a76c39454bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0765e42f-e372-4a49-b764-a76c39454bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (486f2ab5-564e-42d7-a36c-67c344902063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:35 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Volume 203607db-3042-44f2-a0ce-542055ba0921: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-203607db-3042-44f2-a0ce-542055ba0921', 'volume_size': 2, 'snapshot_id': 'fc2e734e-7a59-40c5-8ddb-b051b4bd48ae'} Apr 29 06:44:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:36 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae" returned: 0 in 0.753s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.221s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "cinder-quobyte-fc2e734e-7a59-40c5-8ddb-b051b4bd48ae-203607db-3042-44f2-a0ce-542055ba0921" by "_create_volume_from_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-fc2e734e-7a59-40c5-8ddb-b051b4bd48ae-203607db-3042-44f2-a0ce-542055ba0921" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Creating volume 203607db-3042-44f2-a0ce-542055ba0921 from snapshot fc2e734e-7a59-40c5-8ddb-b051b4bd48ae {{(pid=84195) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "cinder-quobyte-203607db-3042-44f2-a0ce-542055ba0921" by "_copy_volume_from_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG cinder.volume.volume_utils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Attempting download of 3c917343-78b7-403b-853d-4aeabac3edf1 ((None, [{'url': 'file:///opt/stack/data/glance/images/3c917343-78b7-403b-853d-4aeabac3edf1', 'metadata': {}}])) to volume 0fa0cd30-2b30-4dcb-8173-c8f3200a33ae. {{(pid=84195) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-203607db-3042-44f2-a0ce-542055ba0921" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] snapshot: fc2e734e-7a59-40c5-8ddb-b051b4bd48ae, volume: 203607db-3042-44f2-a0ce-542055ba0921, {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d687ae-eab6-4337-b3f8-1e479ff6d870]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.fc2e734e-7a59-40c5-8ddb-b051b4bd48ae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[607609a3-72e2-460a-b76c-cfee8a0d2dc5]: (4, 'raw') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c917343-78b7-403b-853d-4aeabac3edf1_zz6b0lmg {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:36 devstack sudo[91393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.fc2e734e-7a59-40c5-8ddb-b051b4bd48ae Apr 29 06:44:36 devstack sudo[91393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:36 devstack sudo[91394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c917343-78b7-403b-853d-4aeabac3edf1_zz6b0lmg Apr 29 06:44:36 devstack sudo[91394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG oslo_service.periodic_task [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84195) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:36 devstack sudo[91398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:44:36 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:36 devstack sudo[91394]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c917343-78b7-403b-853d-4aeabac3edf1_zz6b0lmg" returned: 0 in 0.805s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c917343-78b7-403b-853d-4aeabac3edf1_zz6b0lmg {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:37 devstack sudo[91393]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.fc2e734e-7a59-40c5-8ddb-b051b4bd48ae" returned: 0 in 0.935s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:37 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:44:37 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 06:44:37 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Creating direct copy from snapshot {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 06:44:37 devstack sudo[91405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c917343-78b7-403b-853d-4aeabac3edf1_zz6b0lmg Apr 29 06:44:37 devstack sudo[91405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:37 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[0945db29-ccc5-4ece-9dbb-bc312ff71635]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:44:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:37 devstack sudo[91407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb Apr 29 06:44:37 devstack sudo[91407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:37 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.816s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:37 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:44:37 devstack sudo[91405]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c917343-78b7-403b-853d-4aeabac3edf1_zz6b0lmg" returned: 1 in 0.751s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c917343-78b7-403b-853d-4aeabac3edf1_zz6b0lmg' failed. Not Retrying. {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 06:44:37 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f9bd2c-4044-457f-ae0e-a430da21bf5d]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:44:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_dt3ugafkdevstack@QuobyteHD {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:37 devstack sudo[91412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_dt3ugafkdevstack@QuobyteHD Apr 29 06:44:37 devstack sudo[91412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:37 devstack sudo[91407]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb" returned: 0 in 0.803s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:37 devstack cinder-volume[84195]: DEBUG cinder.utils [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Path /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-203607db-3042-44f2-a0ce-542055ba0921 not found in is_blk_device check {{(pid=84195) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 06:44:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-203607db-3042-44f2-a0ce-542055ba0921 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:37 devstack sudo[91417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-203607db-3042-44f2-a0ce-542055ba0921 Apr 29 06:44:37 devstack sudo[91417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:38 devstack sudo[91412]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_dt3ugafkdevstack@QuobyteHD" returned: 0 in 0.720s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:38 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] 3c917343-78b7-403b-853d-4aeabac3edf1 was qcow2, converting to raw {{(pid=84195) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 06:44:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_dt3ugafkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:38 devstack sudo[91422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_dt3ugafkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae Apr 29 06:44:38 devstack sudo[91422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:39 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:44:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Flow 'volume_create_manager' (20165d65-d104-4442-aa87-261ae310a6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:44:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (064fefcf-80bf-4ab8-8c3c-5ed1254b59b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (064fefcf-80bf-4ab8-8c3c-5ed1254b59b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1543337516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f0e1ad-dde3-4996-9d3c-b3c6edb65690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e35f85cd440f4abcbd78932646aad119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:44:39Z,use_quota=True,user_id='38ce1bd98a74474185a6ca375a2d651a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc0b1eb-f1cc-4f83-a933-e9eec55b3f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc0b1eb-f1cc-4f83-a933-e9eec55b3f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2affcc44-9093-4fcb-91ec-7b1803388e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2affcc44-9093-4fcb-91ec-7b1803388e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1f0e1ad-dde3-4996-9d3c-b3c6edb65690', 'volume_name': 'volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (741588f5-b37a-4d57-a6c1-3b8ce9bf32d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (741588f5-b37a-4d57-a6c1-3b8ce9bf32d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:39 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d67c7b4f-357c-4f00-9eca-004eeee7e8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:39 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Volume a1f0e1ad-dde3-4996-9d3c-b3c6edb65690: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690', 'volume_size': 1} Apr 29 06:44:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:42 devstack sudo[91422]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_dt3ugafkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae" returned: 0 in 4.221s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:42 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3c917343-78b7-403b-853d-4aeabac3edf1_dt3ugafkdevstack@QuobyteHD, size 112.00 MB, duration 4.22 sec, destination /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae {{(pid=84195) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 06:44:42 devstack cinder-volume[84195]: INFO cinder.image.image_utils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Converted 112.00 MB image at 26.53 MB/s Apr 29 06:44:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:42 devstack sudo[91442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae 1G Apr 29 06:44:42 devstack sudo[91442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:43 devstack sudo[91417]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-203607db-3042-44f2-a0ce-542055ba0921" returned: 0 in 5.212s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:43 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d12202-1085-4483-8121-a37a145d9544]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:44:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:43 devstack sudo[91444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb Apr 29 06:44:43 devstack sudo[91444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:43 devstack sudo[91442]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae 1G" returned: 0 in 0.904s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:43 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e79caa-1d7b-4005-b438-dc2b7345c0bc]: (4, 'raw') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:44:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:43 devstack sudo[91449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae Apr 29 06:44:43 devstack sudo[91449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:44 devstack sudo[91444]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb" returned: 0 in 0.927s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:44 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Image conversion details: src /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb, size 1024.00 MB, duration 5.22 sec, destination /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-203607db-3042-44f2-a0ce-542055ba0921 {{(pid=84195) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 06:44:44 devstack cinder-volume[84195]: INFO cinder.image.image_utils [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Converted 1024.00 MB image at 196.35 MB/s Apr 29 06:44:44 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-203607db-3042-44f2-a0ce-542055ba0921 is being set with open permissions: ugo+rw Apr 29 06:44:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-203607db-3042-44f2-a0ce-542055ba0921 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:44 devstack sudo[91454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-203607db-3042-44f2-a0ce-542055ba0921 Apr 29 06:44:44 devstack sudo[91454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:44 devstack sudo[91449]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae" returned: 0 in 0.702s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:44 devstack sudo[91458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae Apr 29 06:44:44 devstack sudo[91458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:44 devstack sudo[91454]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-203607db-3042-44f2-a0ce-542055ba0921" returned: 0 in 0.605s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:44 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-203607db-3042-44f2-a0ce-542055ba0921" released by "_copy_volume_from_snapshot" :: held 8.605s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:44:44 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-fc2e734e-7a59-40c5-8ddb-b051b4bd48ae-203607db-3042-44f2-a0ce-542055ba0921" released by "_create_volume_from_snapshot" :: held 8.642s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:44:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.665s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:44:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.946s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1543337516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f0e1ad-dde3-4996-9d3c-b3c6edb65690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e35f85cd440f4abcbd78932646aad119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:44:39Z,use_quota=True,user_id='38ce1bd98a74474185a6ca375a2d651a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:44:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Creating volume a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:44:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:44:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:44:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:44:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:44:44 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:44:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:44 devstack sudo[91461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 1073741824 Apr 29 06:44:44 devstack sudo[91461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (486f2ab5-564e-42d7-a36c-67c344902063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-203607db-3042-44f2-a0ce-542055ba0921', 'volume_size': 2, 'snapshot_id': 'fc2e734e-7a59-40c5-8ddb-b051b4bd48ae'}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c182ebe7-20e0-4378-b3da-a6282614cf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:44 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Volume volume-203607db-3042-44f2-a0ce-542055ba0921 (203607db-3042-44f2-a0ce-542055ba0921): created successfully Apr 29 06:44:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c182ebe7-20e0-4378-b3da-a6282614cf51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Flow 'volume_create_manager' (d36782eb-5926-40a2-a95c-e40320ee0071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:44:44 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-10cb7da4-75b4-4628-818d-8803b7ce2365 tempest-VolumesSnapshotTestJSON-917607631 None] Created volume successfully. Apr 29 06:44:45 devstack sudo[91458]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae" returned: 1 in 0.744s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae' failed. Not Retrying. {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 06:44:45 devstack cinder-volume[84195]: DEBUG cinder.volume.volume_utils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Downloaded image 3c917343-78b7-403b-853d-4aeabac3edf1 ((None, [{'url': 'file:///opt/stack/data/glance/images/3c917343-78b7-403b-853d-4aeabac3edf1', 'metadata': {}}])) to volume 0fa0cd30-2b30-4dcb-8173-c8f3200a33ae successfully. {{(pid=84195) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 06:44:45 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Temporary image 3c917343-78b7-403b-853d-4aeabac3edf1 for user 06cc891a9531440bbb8284f270dc9596 is deleted. {{(pid=84195) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 06:44:45 devstack cinder-volume[84195]: DEBUG cinder.volume.volume_utils [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Marking volume 0fa0cd30-2b30-4dcb-8173-c8f3200a33ae as bootable. {{(pid=84195) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 06:44:45 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Copying metadata from image 3c917343-78b7-403b-853d-4aeabac3edf1 to 0fa0cd30-2b30-4dcb-8173-c8f3200a33ae. {{(pid=84195) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 06:44:45 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Creating volume glance metadata for volume 0fa0cd30-2b30-4dcb-8173-c8f3200a33ae backed by image 3c917343-78b7-403b-853d-4aeabac3edf1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3c917343-78b7-403b-853d-4aeabac3edf1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84195) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 06:44:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cac0c20-0048-4b30-9cc1-179f013f38cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae', 'volume_size': 1, 'image_id': '3c917343-78b7-403b-853d-4aeabac3edf1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c917343-78b7-403b-853d-4aeabac3edf1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0b2d77ae633e436aa18dac7e4fad942b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3c917343-78b7-403b-853d-4aeabac3edf1', 'created_at': datetime.datetime(2026, 4, 29, 4, 32, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 4, 32, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c917343-78b7-403b-853d-4aeabac3edf1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6120eb-68f7-433a-b89d-11ec6d7061f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:45 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Volume volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae (0fa0cd30-2b30-4dcb-8173-c8f3200a33ae): created successfully Apr 29 06:44:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6120eb-68f7-433a-b89d-11ec6d7061f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Flow 'volume_create_manager' (f27853d1-380c-4374-b65b-445142e2b88e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:44:45 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-959b13ff-323e-445d-8447-e6606ef0cd3a tempest-VolumesImageMetadata-1180026918 None] Created volume successfully. Apr 29 06:44:45 devstack sudo[91461]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 1073741824" returned: 0 in 0.790s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:45 devstack sudo[91469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 Apr 29 06:44:45 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:45 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3d1b4886-be8b-4925-ae34-84d503d5e584 tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "cinder-203607db-3042-44f2-a0ce-542055ba0921-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:44:45 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3d1b4886-be8b-4925-ae34-84d503d5e584 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-203607db-3042-44f2-a0ce-542055ba0921-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:44:45 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3d1b4886-be8b-4925-ae34-84d503d5e584 tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "cinder-quobyte-203607db-3042-44f2-a0ce-542055ba0921" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:44:45 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3d1b4886-be8b-4925-ae34-84d503d5e584 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-203607db-3042-44f2-a0ce-542055ba0921" acquired by "delete_volume" :: waited 0.015s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:44:45 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[2934be83-7c7f-427d-a1e6-cfc7663aa4c3]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:44:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3d1b4886-be8b-4925-ae34-84d503d5e584 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-203607db-3042-44f2-a0ce-542055ba0921 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:45 devstack sudo[91471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-203607db-3042-44f2-a0ce-542055ba0921 Apr 29 06:44:45 devstack sudo[91471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:46 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690" returned: 0 in 0.671s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:44:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:44:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d67c7b4f-357c-4f00-9eca-004eeee7e8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b001dc4c-f06a-442d-885d-b9acd554a357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:46 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Volume volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 (a1f0e1ad-dde3-4996-9d3c-b3c6edb65690): created successfully Apr 29 06:44:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b001dc4c-f06a-442d-885d-b9acd554a357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Flow 'volume_create_manager' (20165d65-d104-4442-aa87-261ae310a6a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:44:46 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-cea13866-f4a5-4309-8213-0dcd062f3234 tempest-VolumesCloneTest-1539663861 None] Created volume successfully. Apr 29 06:44:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-0dd4f806-48f3-4cbf-8016-8103676bb29a tempest-VolumesImageMetadata-1180026918 None] Acquiring lock "cinder-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:44:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-0dd4f806-48f3-4cbf-8016-8103676bb29a tempest-VolumesImageMetadata-1180026918 None] Lock "cinder-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:44:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-0dd4f806-48f3-4cbf-8016-8103676bb29a tempest-VolumesImageMetadata-1180026918 None] Acquiring lock "cinder-quobyte-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:44:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-0dd4f806-48f3-4cbf-8016-8103676bb29a tempest-VolumesImageMetadata-1180026918 None] Lock "cinder-quobyte-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae" acquired by "delete_volume" :: waited 0.014s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:44:46 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d6552b-5add-4837-a4e6-3216f1f11a0d]: (4, 'raw') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:44:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0dd4f806-48f3-4cbf-8016-8103676bb29a tempest-VolumesImageMetadata-1180026918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:46 devstack sudo[91471]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3d1b4886-be8b-4925-ae34-84d503d5e584 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-203607db-3042-44f2-a0ce-542055ba0921" returned: 0 in 0.763s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3d1b4886-be8b-4925-ae34-84d503d5e584 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-203607db-3042-44f2-a0ce-542055ba0921 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:46 devstack sudo[91478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae Apr 29 06:44:46 devstack sudo[91478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:46 devstack sudo[91479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-203607db-3042-44f2-a0ce-542055ba0921 Apr 29 06:44:46 devstack sudo[91479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:47 devstack sudo[91479]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3d1b4886-be8b-4925-ae34-84d503d5e584 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-203607db-3042-44f2-a0ce-542055ba0921" returned: 0 in 0.638s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3d1b4886-be8b-4925-ae34-84d503d5e584 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-203607db-3042-44f2-a0ce-542055ba0921" released by "delete_volume" :: held 1.447s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:44:47 devstack sudo[91478]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0dd4f806-48f3-4cbf-8016-8103676bb29a tempest-VolumesImageMetadata-1180026918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae" returned: 0 in 0.753s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0dd4f806-48f3-4cbf-8016-8103676bb29a tempest-VolumesImageMetadata-1180026918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:47 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-3d1b4886-be8b-4925-ae34-84d503d5e584 tempest-VolumesSnapshotTestJSON-917607631 None] Created reservations ['69ce9633-3da8-467d-aa44-dd301101a4b9', '61258024-9c65-4a75-aa17-04771b9555ee', '1a58019b-1f67-43e0-9a54-9da81c9ef983', '03955016-48cc-4ff6-a2d7-341b672b5a23'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:44:47 devstack sudo[91486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae Apr 29 06:44:47 devstack sudo[91486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3d1b4886-be8b-4925-ae34-84d503d5e584 tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3d1b4886-be8b-4925-ae34-84d503d5e584 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-3d1b4886-be8b-4925-ae34-84d503d5e584 tempest-VolumesSnapshotTestJSON-917607631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:44:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-3d1b4886-be8b-4925-ae34-84d503d5e584 tempest-VolumesSnapshotTestJSON-917607631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:44:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3d1b4886-be8b-4925-ae34-84d503d5e584 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:44:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3d1b4886-be8b-4925-ae34-84d503d5e584 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:47 devstack sudo[91488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:44:47 devstack sudo[91488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:47 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:44:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Flow 'volume_create_manager' (11f151e4-4a47-44e0-915f-da28ff340818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:44:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762f5c30-9885-4ea4-be9e-03c898874a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762f5c30-9885-4ea4-be9e-03c898874a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-363369626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08c3db3-115e-485f-83ff-b309c4cce2a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e35f85cd440f4abcbd78932646aad119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:44:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=a1f0e1ad-dde3-4996-9d3c-b3c6edb65690,status='creating',terminated_at=None,updated_at=2026-04-29T04:44:48Z,use_quota=True,user_id='38ce1bd98a74474185a6ca375a2d651a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a60105-c431-4485-a7c0-e96c8a9d0a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a60105-c431-4485-a7c0-e96c8a9d0a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (772be710-6287-4774-8331-dff309c5f00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (772be710-6287-4774-8331-dff309c5f00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd08c3db3-115e-485f-83ff-b309c4cce2a4', 'volume_name': 'volume-d08c3db3-115e-485f-83ff-b309c4cce2a4', 'volume_size': 2, 'source_volid': 'a1f0e1ad-dde3-4996-9d3c-b3c6edb65690', 'source_volstatus': 'available'}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e403fd2-89cc-45db-a048-17be0e4eac72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e403fd2-89cc-45db-a048-17be0e4eac72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71551829-b10e-40c6-aed3-333b0d36ee2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:47 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Volume d08c3db3-115e-485f-83ff-b309c4cce2a4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d08c3db3-115e-485f-83ff-b309c4cce2a4', 'volume_size': 2, 'source_volid': 'a1f0e1ad-dde3-4996-9d3c-b3c6edb65690', 'source_volstatus': 'available'} Apr 29 06:44:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:47 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Cloning volume a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 to volume d08c3db3-115e-485f-83ff-b309c4cce2a4 Apr 29 06:44:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Creating offline snapshot fa6054b2-e48c-45c2-ac11-03f4d8df1868 of volume a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:44:47 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[57525a01-f54c-47df-ab9f-cd7d0a4c2f87]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:44:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:48 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3e60706e-aecb-434c-8d42-2a4cd219baeb tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "cinder-fc2e734e-7a59-40c5-8ddb-b051b4bd48ae-delete_snapshot" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:44:48 devstack sudo[91491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 Apr 29 06:44:48 devstack sudo[91491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:48 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3e60706e-aecb-434c-8d42-2a4cd219baeb tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-fc2e734e-7a59-40c5-8ddb-b051b4bd48ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:44:48 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3e60706e-aecb-434c-8d42-2a4cd219baeb tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "cinder-quobyte-790d7a32-0854-4bba-bc6a-3f62fb474ecb" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:44:48 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3e60706e-aecb-434c-8d42-2a4cd219baeb tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-790d7a32-0854-4bba-bc6a-3f62fb474ecb" acquired by "delete_snapshot" :: waited 0.041s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:44:48 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3e60706e-aecb-434c-8d42-2a4cd219baeb tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "cinder-quobyte-fc2e734e-7a59-40c5-8ddb-b051b4bd48ae" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:44:48 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3e60706e-aecb-434c-8d42-2a4cd219baeb tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-fc2e734e-7a59-40c5-8ddb-b051b4bd48ae" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:44:48 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-3e60706e-aecb-434c-8d42-2a4cd219baeb tempest-VolumesSnapshotTestJSON-917607631 None] Deleting offline snapshot fc2e734e-7a59-40c5-8ddb-b051b4bd48ae of volume 790d7a32-0854-4bba-bc6a-3f62fb474ecb {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:44:48 devstack sudo[91488]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:48 devstack sudo[91486]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:48 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-3e60706e-aecb-434c-8d42-2a4cd219baeb tempest-VolumesSnapshotTestJSON-917607631 None] snapshot_file for this snap is: volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.fc2e734e-7a59-40c5-8ddb-b051b4bd48ae {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:44:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3d1b4886-be8b-4925-ae34-84d503d5e584 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.780s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0dd4f806-48f3-4cbf-8016-8103676bb29a tempest-VolumesImageMetadata-1180026918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae" returned: 1 in 0.929s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0dd4f806-48f3-4cbf-8016-8103676bb29a tempest-VolumesImageMetadata-1180026918 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae' failed. Not Retrying. {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 06:44:48 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-3d1b4886-be8b-4925-ae34-84d503d5e584 tempest-VolumesSnapshotTestJSON-917607631 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:44:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0dd4f806-48f3-4cbf-8016-8103676bb29a tempest-VolumesImageMetadata-1180026918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:48 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8d113d-8da1-4742-b2e1-43eb4d1f2105]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:44:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3e60706e-aecb-434c-8d42-2a4cd219baeb tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.fc2e734e-7a59-40c5-8ddb-b051b4bd48ae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:48 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-3d1b4886-be8b-4925-ae34-84d503d5e584 tempest-VolumesSnapshotTestJSON-917607631 None] Deleted volume successfully. Apr 29 06:44:48 devstack sudo[91496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae Apr 29 06:44:48 devstack sudo[91496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:48 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3d1b4886-be8b-4925-ae34-84d503d5e584 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-203607db-3042-44f2-a0ce-542055ba0921-delete_volume" released by "delete_volume" :: held 2.503s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:44:48 devstack sudo[91497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.fc2e734e-7a59-40c5-8ddb-b051b4bd48ae Apr 29 06:44:48 devstack sudo[91497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:48 devstack sudo[91491]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690" returned: 0 in 0.799s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.fa6054b2-e48c-45c2-ac11-03f4d8df1868 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:48 devstack sudo[91503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.fa6054b2-e48c-45c2-ac11-03f4d8df1868 1G Apr 29 06:44:48 devstack sudo[91503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:48 devstack sudo[91496]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0dd4f806-48f3-4cbf-8016-8103676bb29a tempest-VolumesImageMetadata-1180026918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae" returned: 0 in 0.694s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:48 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-0dd4f806-48f3-4cbf-8016-8103676bb29a tempest-VolumesImageMetadata-1180026918 None] Lock "cinder-quobyte-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae" released by "delete_volume" :: held 2.442s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:44:48 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-0dd4f806-48f3-4cbf-8016-8103676bb29a tempest-VolumesImageMetadata-1180026918 None] Created reservations ['a637409f-e8ee-4492-bc45-d1f22f1b39a0', '2c523fc7-99d8-4031-8c49-a4a35cbe65f6', '872f41dc-e8a7-45f9-96cc-a99c8edc4d7e', '81abec7d-511a-4af5-b1d1-903da0ac313d'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:44:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-0dd4f806-48f3-4cbf-8016-8103676bb29a tempest-VolumesImageMetadata-1180026918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-0dd4f806-48f3-4cbf-8016-8103676bb29a tempest-VolumesImageMetadata-1180026918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-0dd4f806-48f3-4cbf-8016-8103676bb29a tempest-VolumesImageMetadata-1180026918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:44:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-0dd4f806-48f3-4cbf-8016-8103676bb29a tempest-VolumesImageMetadata-1180026918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:44:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-0dd4f806-48f3-4cbf-8016-8103676bb29a tempest-VolumesImageMetadata-1180026918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:44:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0dd4f806-48f3-4cbf-8016-8103676bb29a tempest-VolumesImageMetadata-1180026918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:49 devstack sudo[91497]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3e60706e-aecb-434c-8d42-2a4cd219baeb tempest-VolumesSnapshotTestJSON-917607631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.fc2e734e-7a59-40c5-8ddb-b051b4bd48ae" returned: 0 in 0.827s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-3e60706e-aecb-434c-8d42-2a4cd219baeb tempest-VolumesSnapshotTestJSON-917607631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:44:49 devstack sudo[91509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:44:49 devstack sudo[91509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:49 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[460c3fd0-2c6c-4100-83db-7aa263a41392]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:44:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3e60706e-aecb-434c-8d42-2a4cd219baeb tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:49 devstack sudo[91511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb Apr 29 06:44:49 devstack sudo[91511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:49 devstack sudo[91503]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.fa6054b2-e48c-45c2-ac11-03f4d8df1868 1G" returned: 0 in 0.785s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.fa6054b2-e48c-45c2-ac11-03f4d8df1868 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:49 devstack sudo[91516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.fa6054b2-e48c-45c2-ac11-03f4d8df1868 Apr 29 06:44:49 devstack sudo[91516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:49 devstack sudo[91509]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0dd4f806-48f3-4cbf-8016-8103676bb29a tempest-VolumesImageMetadata-1180026918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.645s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:49 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-0dd4f806-48f3-4cbf-8016-8103676bb29a tempest-VolumesImageMetadata-1180026918 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:44:49 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-0dd4f806-48f3-4cbf-8016-8103676bb29a tempest-VolumesImageMetadata-1180026918 None] Deleted volume successfully. Apr 29 06:44:49 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-0dd4f806-48f3-4cbf-8016-8103676bb29a tempest-VolumesImageMetadata-1180026918 None] Lock "cinder-0fa0cd30-2b30-4dcb-8173-c8f3200a33ae-delete_volume" released by "delete_volume" :: held 3.304s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:44:49 devstack sudo[91511]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3e60706e-aecb-434c-8d42-2a4cd219baeb tempest-VolumesSnapshotTestJSON-917607631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb" returned: 0 in 0.805s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3e60706e-aecb-434c-8d42-2a4cd219baeb tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.fc2e734e-7a59-40c5-8ddb-b051b4bd48ae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:49 devstack sudo[91522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.fc2e734e-7a59-40c5-8ddb-b051b4bd48ae Apr 29 06:44:49 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:50 devstack sudo[91516]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.fa6054b2-e48c-45c2-ac11-03f4d8df1868" returned: 0 in 0.688s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:50 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.fa6054b2-e48c-45c2-ac11-03f4d8df1868 is being set with open permissions: ugo+rw Apr 29 06:44:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.fa6054b2-e48c-45c2-ac11-03f4d8df1868 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:50 devstack sudo[91527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.fa6054b2-e48c-45c2-ac11-03f4d8df1868 Apr 29 06:44:50 devstack sudo[91527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:50 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3e60706e-aecb-434c-8d42-2a4cd219baeb tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.fc2e734e-7a59-40c5-8ddb-b051b4bd48ae" returned: 0 in 0.771s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3e60706e-aecb-434c-8d42-2a4cd219baeb tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.fc2e734e-7a59-40c5-8ddb-b051b4bd48ae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:50 devstack sudo[91533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.fc2e734e-7a59-40c5-8ddb-b051b4bd48ae Apr 29 06:44:50 devstack sudo[91533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:50 devstack sudo[91527]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.fa6054b2-e48c-45c2-ac11-03f4d8df1868" returned: 0 in 0.659s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:50 devstack sudo[91536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.info Apr 29 06:44:50 devstack sudo[91536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:51 devstack sudo[91533]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3e60706e-aecb-434c-8d42-2a4cd219baeb tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb.fc2e734e-7a59-40c5-8ddb-b051b4bd48ae" returned: 0 in 0.717s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:51 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3e60706e-aecb-434c-8d42-2a4cd219baeb tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-fc2e734e-7a59-40c5-8ddb-b051b4bd48ae" released by "_delete_snapshot" :: held 3.261s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:44:51 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3e60706e-aecb-434c-8d42-2a4cd219baeb tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-790d7a32-0854-4bba-bc6a-3f62fb474ecb" released by "delete_snapshot" :: held 3.294s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:44:51 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-3e60706e-aecb-434c-8d42-2a4cd219baeb tempest-VolumesSnapshotTestJSON-917607631 None] Created reservations ['cbd59fb6-9a0c-4785-8af0-a45d9e52b1d7', '0a5846c1-f01b-4687-b93d-2bbbafe1a23a', 'babd7229-20f6-4179-8e68-05546af42075', '7a2b9058-acc8-4103-9f44-4f2c6fb43f12'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:44:51 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-3e60706e-aecb-434c-8d42-2a4cd219baeb tempest-VolumesSnapshotTestJSON-917607631 None] Delete snapshot completed successfully. Apr 29 06:44:51 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3e60706e-aecb-434c-8d42-2a4cd219baeb tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-fc2e734e-7a59-40c5-8ddb-b051b4bd48ae-delete_snapshot" released by "delete_snapshot" :: held 3.475s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:44:51 devstack sudo[91536]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.info" returned: 0 in 0.642s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:51 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.info is being set with open permissions: ugo+rw Apr 29 06:44:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:51 devstack sudo[91540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.info Apr 29 06:44:51 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:52 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.info" returned: 0 in 0.629s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:52 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Acquiring lock "cinder-quobyte-d08c3db3-115e-485f-83ff-b309c4cce2a4" by "_copy_volume_from_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:44:52 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Lock "cinder-quobyte-d08c3db3-115e-485f-83ff-b309c4cce2a4" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:44:52 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] snapshot: fa6054b2-e48c-45c2-ac11-03f4d8df1868, volume: d08c3db3-115e-485f-83ff-b309c4cce2a4, {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 06:44:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:52 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:44:52 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:44:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:44:52 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf7fe49-d16b-42d1-9de1-ab16345cd43d]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:44:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.fa6054b2-e48c-45c2-ac11-03f4d8df1868 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:52 devstack sudo[91543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.fa6054b2-e48c-45c2-ac11-03f4d8df1868 Apr 29 06:44:52 devstack sudo[91543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:52 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1b9a2902-8b84-4506-a9e2-9dbb133fbe1d tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "cinder-790d7a32-0854-4bba-bc6a-3f62fb474ecb-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:44:52 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1b9a2902-8b84-4506-a9e2-9dbb133fbe1d tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-790d7a32-0854-4bba-bc6a-3f62fb474ecb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:44:52 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1b9a2902-8b84-4506-a9e2-9dbb133fbe1d tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "cinder-quobyte-790d7a32-0854-4bba-bc6a-3f62fb474ecb" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:44:52 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1b9a2902-8b84-4506-a9e2-9dbb133fbe1d tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-790d7a32-0854-4bba-bc6a-3f62fb474ecb" acquired by "delete_volume" :: waited 0.020s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:44:52 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5413b17-f8a3-48d8-843e-4bc57e3a1a28]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:44:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1b9a2902-8b84-4506-a9e2-9dbb133fbe1d tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:52 devstack sudo[91545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb Apr 29 06:44:52 devstack sudo[91545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:53 devstack sudo[91543]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.fa6054b2-e48c-45c2-ac11-03f4d8df1868" returned: 0 in 0.780s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:53 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:44:53 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 06:44:53 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Creating direct copy from snapshot {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 06:44:53 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c61d10e-5107-47e8-9665-fdd80457007e]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:44:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:53 devstack sudo[91550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 Apr 29 06:44:53 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:53 devstack sudo[91545]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1b9a2902-8b84-4506-a9e2-9dbb133fbe1d tempest-VolumesSnapshotTestJSON-917607631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb" returned: 0 in 0.822s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1b9a2902-8b84-4506-a9e2-9dbb133fbe1d tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:53 devstack sudo[91556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb Apr 29 06:44:53 devstack sudo[91556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:53 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:44:53 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Flow 'volume_create_manager' (dd2e1a79-e6c2-4f0c-85a7-460e7d782528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:44:53 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcfc1c61-993d-45fe-bb14-3f2b81d27477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:53 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcfc1c61-993d-45fe-bb14-3f2b81d27477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1484417563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14df9f07-9b8b-48d1-9797-2d814045706a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b66b4dfd44647e487d05712389ed98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:44:54Z,use_quota=True,user_id='b1a391fb7af54c0cb5056a79fec82bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:53 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3606ffde-c967-4698-838f-d5ba12e43daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:53 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3606ffde-c967-4698-838f-d5ba12e43daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:53 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb32e26-73e1-41ce-b7ed-0a1f6ea82198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:53 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb32e26-73e1-41ce-b7ed-0a1f6ea82198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14df9f07-9b8b-48d1-9797-2d814045706a', 'volume_name': 'volume-14df9f07-9b8b-48d1-9797-2d814045706a', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:53 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e019774b-37e6-4675-a700-11ef6466bef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:53 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e019774b-37e6-4675-a700-11ef6466bef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:53 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea06055d-9460-4363-9d58-66293a228b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:53 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Volume 14df9f07-9b8b-48d1-9797-2d814045706a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14df9f07-9b8b-48d1-9797-2d814045706a', 'volume_size': 1} Apr 29 06:44:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:53 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690" returned: 0 in 0.795s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:53 devstack cinder-volume[84195]: DEBUG cinder.utils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Path /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d08c3db3-115e-485f-83ff-b309c4cce2a4 not found in is_blk_device check {{(pid=84195) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 06:44:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d08c3db3-115e-485f-83ff-b309c4cce2a4 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:53 devstack sudo[91561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d08c3db3-115e-485f-83ff-b309c4cce2a4 Apr 29 06:44:53 devstack sudo[91561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:54 devstack sudo[91556]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1b9a2902-8b84-4506-a9e2-9dbb133fbe1d tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-790d7a32-0854-4bba-bc6a-3f62fb474ecb" returned: 0 in 0.642s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:54 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1b9a2902-8b84-4506-a9e2-9dbb133fbe1d tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-790d7a32-0854-4bba-bc6a-3f62fb474ecb" released by "delete_volume" :: held 1.536s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:44:54 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-1b9a2902-8b84-4506-a9e2-9dbb133fbe1d tempest-VolumesSnapshotTestJSON-917607631 None] Created reservations ['84d3ee74-81af-46d4-853e-718c413878f9', '03f8e8e6-1aed-4565-8de5-b5175dfdcf4d', '3fa4064f-73c1-4cf1-9fb3-b6e5fbe92175', 'c4949576-4918-4d9e-9d14-5ed2b43cdfbc'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:44:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1b9a2902-8b84-4506-a9e2-9dbb133fbe1d tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1b9a2902-8b84-4506-a9e2-9dbb133fbe1d tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:44:54 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1b9a2902-8b84-4506-a9e2-9dbb133fbe1d tempest-VolumesSnapshotTestJSON-917607631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:44:54 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1b9a2902-8b84-4506-a9e2-9dbb133fbe1d tempest-VolumesSnapshotTestJSON-917607631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:44:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1b9a2902-8b84-4506-a9e2-9dbb133fbe1d tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:44:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1b9a2902-8b84-4506-a9e2-9dbb133fbe1d tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:54 devstack sudo[91564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:44:54 devstack sudo[91564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:54 devstack sudo[91564]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1b9a2902-8b84-4506-a9e2-9dbb133fbe1d tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.768s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:54 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-1b9a2902-8b84-4506-a9e2-9dbb133fbe1d tempest-VolumesSnapshotTestJSON-917607631 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:44:54 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-1b9a2902-8b84-4506-a9e2-9dbb133fbe1d tempest-VolumesSnapshotTestJSON-917607631 None] Deleted volume successfully. Apr 29 06:44:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1b9a2902-8b84-4506-a9e2-9dbb133fbe1d tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-790d7a32-0854-4bba-bc6a-3f62fb474ecb-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:44:55 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:44:55 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Flow 'volume_create_manager' (fd66fe3f-1d11-479f-91ad-09defd797e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:44:55 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed4e5eef-ee9b-4193-9900-7a94ccc68b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:55 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed4e5eef-ee9b-4193-9900-7a94ccc68b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1273380010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f41dea-11e3-4e4c-b8bd-6873ee1680d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e37e8c2a947444f9c90642a08cfb2fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:44:55Z,use_quota=True,user_id='fb914768d2944715bbeff26f818adc68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:55 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63be31d-7592-4091-8eda-23dbf2110eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:55 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63be31d-7592-4091-8eda-23dbf2110eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:55 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0abb9fd-8d9d-406d-bc14-e02529d6ebd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:55 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0abb9fd-8d9d-406d-bc14-e02529d6ebd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6f41dea-11e3-4e4c-b8bd-6873ee1680d7', 'volume_name': 'volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:55 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def90b4d-faf9-4ebd-ae8c-bba4d2f3341a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:55 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def90b4d-faf9-4ebd-ae8c-bba4d2f3341a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:44:55 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676b8489-4ddc-439a-9076-46c2c30c9d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:44:55 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Volume e6f41dea-11e3-4e4c-b8bd-6873ee1680d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7', 'volume_size': 1} Apr 29 06:44:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:44:58 devstack sudo[91561]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d08c3db3-115e-485f-83ff-b309c4cce2a4" returned: 0 in 4.843s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:58 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[a290d76f-47f9-4eea-82f6-d579ea75e6cb]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:44:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:58 devstack sudo[91579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 Apr 29 06:44:58 devstack sudo[91579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:44:59 devstack sudo[91579]: pam_unix(sudo:session): session closed for user root Apr 29 06:44:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690" returned: 0 in 0.861s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:44:59 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Image conversion details: src /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690, size 1024.00 MB, duration 4.84 sec, destination /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d08c3db3-115e-485f-83ff-b309c4cce2a4 {{(pid=84195) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 06:44:59 devstack cinder-volume[84195]: INFO cinder.image.image_utils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Converted 1024.00 MB image at 211.39 MB/s Apr 29 06:44:59 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d08c3db3-115e-485f-83ff-b309c4cce2a4 is being set with open permissions: ugo+rw Apr 29 06:44:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d08c3db3-115e-485f-83ff-b309c4cce2a4 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:44:59 devstack sudo[91584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d08c3db3-115e-485f-83ff-b309c4cce2a4 Apr 29 06:44:59 devstack sudo[91584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:00 devstack sudo[91584]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d08c3db3-115e-485f-83ff-b309c4cce2a4" returned: 0 in 0.649s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Lock "cinder-quobyte-d08c3db3-115e-485f-83ff-b309c4cce2a4" released by "_copy_volume_from_snapshot" :: held 8.020s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Acquiring lock "cinder-quobyte-fa6054b2-e48c-45c2-ac11-03f4d8df1868" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Lock "cinder-quobyte-fa6054b2-e48c-45c2-ac11-03f4d8df1868" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:00 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Deleting offline snapshot fa6054b2-e48c-45c2-ac11-03f4d8df1868 of volume a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:45:00 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] snapshot_file for this snap is: volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.fa6054b2-e48c-45c2-ac11-03f4d8df1868 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:45:00 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9838ed5-d71c-4ab5-b25a-116efdf2dc84]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:45:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.fa6054b2-e48c-45c2-ac11-03f4d8df1868 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:00 devstack sudo[91587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.fa6054b2-e48c-45c2-ac11-03f4d8df1868 Apr 29 06:45:00 devstack sudo[91587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:01 devstack sudo[91587]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.fa6054b2-e48c-45c2-ac11-03f4d8df1868" returned: 0 in 0.757s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:01 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:45:01 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0975b87-4790-433b-8897-62b17ac5afc2]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:45:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:01 devstack sudo[91592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 Apr 29 06:45:01 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:01 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690" returned: 0 in 0.736s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.fa6054b2-e48c-45c2-ac11-03f4d8df1868 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:01 devstack sudo[91597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.fa6054b2-e48c-45c2-ac11-03f4d8df1868 Apr 29 06:45:01 devstack sudo[91597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:02 devstack sudo[91597]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.fa6054b2-e48c-45c2-ac11-03f4d8df1868" returned: 0 in 0.680s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.fa6054b2-e48c-45c2-ac11-03f4d8df1868 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:02 devstack sudo[91605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.fa6054b2-e48c-45c2-ac11-03f4d8df1868 Apr 29 06:45:02 devstack sudo[91605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:03 devstack sudo[91605]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690.fa6054b2-e48c-45c2-ac11-03f4d8df1868" returned: 0 in 0.625s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:03 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Lock "cinder-quobyte-fa6054b2-e48c-45c2-ac11-03f4d8df1868" released by "_delete_snapshot" :: held 2.884s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.315s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.429s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:03 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1484417563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14df9f07-9b8b-48d1-9797-2d814045706a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b66b4dfd44647e487d05712389ed98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:44:54Z,use_quota=True,user_id='b1a391fb7af54c0cb5056a79fec82bfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:45:03 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Creating volume 14df9f07-9b8b-48d1-9797-2d814045706a {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:45:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:03 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:45:03 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:45:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:03 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:45:03 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:45:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14df9f07-9b8b-48d1-9797-2d814045706a 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:03 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71551829-b10e-40c6-aed3-333b0d36ee2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d08c3db3-115e-485f-83ff-b309c4cce2a4', 'volume_size': 2, 'source_volid': 'a1f0e1ad-dde3-4996-9d3c-b3c6edb65690', 'source_volstatus': 'available'}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:03 devstack sudo[91608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14df9f07-9b8b-48d1-9797-2d814045706a 1073741824 Apr 29 06:45:03 devstack sudo[91608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:03 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab20acf-15ea-432c-bd14-10d15b6fc336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:03 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Volume volume-d08c3db3-115e-485f-83ff-b309c4cce2a4 (d08c3db3-115e-485f-83ff-b309c4cce2a4): created successfully Apr 29 06:45:03 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab20acf-15ea-432c-bd14-10d15b6fc336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:03 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Flow 'volume_create_manager' (11f151e4-4a47-44e0-915f-da28ff340818) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:45:03 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-583d16ae-a197-488d-8bcb-7f18cc677722 tempest-VolumesCloneTest-1539663861 None] Created volume successfully. Apr 29 06:45:04 devstack sudo[91608]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14df9f07-9b8b-48d1-9797-2d814045706a 1073741824" returned: 0 in 0.789s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14df9f07-9b8b-48d1-9797-2d814045706a {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:04 devstack sudo[91613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14df9f07-9b8b-48d1-9797-2d814045706a Apr 29 06:45:04 devstack sudo[91613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:04 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-bd5e9e61-bb4f-43d1-97ef-34cd94abfa6a tempest-VolumesCloneTest-1539663861 None] Acquiring lock "cinder-d08c3db3-115e-485f-83ff-b309c4cce2a4-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:04 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-bd5e9e61-bb4f-43d1-97ef-34cd94abfa6a tempest-VolumesCloneTest-1539663861 None] Lock "cinder-d08c3db3-115e-485f-83ff-b309c4cce2a4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:04 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-bd5e9e61-bb4f-43d1-97ef-34cd94abfa6a tempest-VolumesCloneTest-1539663861 None] Acquiring lock "cinder-quobyte-d08c3db3-115e-485f-83ff-b309c4cce2a4" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:04 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-bd5e9e61-bb4f-43d1-97ef-34cd94abfa6a tempest-VolumesCloneTest-1539663861 None] Lock "cinder-quobyte-d08c3db3-115e-485f-83ff-b309c4cce2a4" acquired by "delete_volume" :: waited 0.027s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:04 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c77a28-a4ab-4812-a0de-b238a2d0eded]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:45:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bd5e9e61-bb4f-43d1-97ef-34cd94abfa6a tempest-VolumesCloneTest-1539663861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d08c3db3-115e-485f-83ff-b309c4cce2a4 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:04 devstack sudo[91615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d08c3db3-115e-485f-83ff-b309c4cce2a4 Apr 29 06:45:04 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:04 devstack sudo[91613]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14df9f07-9b8b-48d1-9797-2d814045706a" returned: 0 in 0.672s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:45:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1273380010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f41dea-11e3-4e4c-b8bd-6873ee1680d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e37e8c2a947444f9c90642a08cfb2fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:44:55Z,use_quota=True,user_id='fb914768d2944715bbeff26f818adc68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:45:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Creating volume e6f41dea-11e3-4e4c-b8bd-6873ee1680d7 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:45:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:45:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:45:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:45:04 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:45:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea06055d-9460-4363-9d58-66293a228b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14df9f07-9b8b-48d1-9797-2d814045706a', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:04 devstack sudo[91618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7 1073741824 Apr 29 06:45:04 devstack sudo[91618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d614d1a1-a174-42b2-a149-6186773f7f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:04 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Volume volume-14df9f07-9b8b-48d1-9797-2d814045706a (14df9f07-9b8b-48d1-9797-2d814045706a): created successfully Apr 29 06:45:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d614d1a1-a174-42b2-a149-6186773f7f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Flow 'volume_create_manager' (dd2e1a79-e6c2-4f0c-85a7-460e7d782528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:45:04 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-1afa0524-94dd-4127-b032-b5be60efcb72 tempest-AbsoluteLimitsTests-454722278 None] Created volume successfully. Apr 29 06:45:04 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bd5e9e61-bb4f-43d1-97ef-34cd94abfa6a tempest-VolumesCloneTest-1539663861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d08c3db3-115e-485f-83ff-b309c4cce2a4" returned: 0 in 0.749s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bd5e9e61-bb4f-43d1-97ef-34cd94abfa6a tempest-VolumesCloneTest-1539663861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d08c3db3-115e-485f-83ff-b309c4cce2a4 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:05 devstack sudo[91623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d08c3db3-115e-485f-83ff-b309c4cce2a4 Apr 29 06:45:05 devstack sudo[91623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:05 devstack sudo[91618]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7 1073741824" returned: 0 in 0.858s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:05 devstack sudo[91623]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bd5e9e61-bb4f-43d1-97ef-34cd94abfa6a tempest-VolumesCloneTest-1539663861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d08c3db3-115e-485f-83ff-b309c4cce2a4" returned: 0 in 0.612s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:05 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-bd5e9e61-bb4f-43d1-97ef-34cd94abfa6a tempest-VolumesCloneTest-1539663861 None] Lock "cinder-quobyte-d08c3db3-115e-485f-83ff-b309c4cce2a4" released by "delete_volume" :: held 1.409s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:05 devstack sudo[91629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7 Apr 29 06:45:05 devstack sudo[91629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:05 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-bd5e9e61-bb4f-43d1-97ef-34cd94abfa6a tempest-VolumesCloneTest-1539663861 None] Created reservations ['6bb36c93-fcca-4af2-85b0-9157e101ede1', 'bb78c179-2910-4000-99f9-a526a81d28d8', 'e3e72e24-3a38-402a-9ec5-bdbd03921f95', 'fb786c52-f4ac-428c-a7ba-50aefdaa295e'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:45:05 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5d9009e2-b988-496f-a213-5cf133ff4c57 tempest-AbsoluteLimitsTests-454722278 None] Acquiring lock "cinder-14df9f07-9b8b-48d1-9797-2d814045706a-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:05 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5d9009e2-b988-496f-a213-5cf133ff4c57 tempest-AbsoluteLimitsTests-454722278 None] Lock "cinder-14df9f07-9b8b-48d1-9797-2d814045706a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-bd5e9e61-bb4f-43d1-97ef-34cd94abfa6a tempest-VolumesCloneTest-1539663861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-bd5e9e61-bb4f-43d1-97ef-34cd94abfa6a tempest-VolumesCloneTest-1539663861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:05 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-bd5e9e61-bb4f-43d1-97ef-34cd94abfa6a tempest-VolumesCloneTest-1539663861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:45:05 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-bd5e9e61-bb4f-43d1-97ef-34cd94abfa6a tempest-VolumesCloneTest-1539663861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:45:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-bd5e9e61-bb4f-43d1-97ef-34cd94abfa6a tempest-VolumesCloneTest-1539663861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bd5e9e61-bb4f-43d1-97ef-34cd94abfa6a tempest-VolumesCloneTest-1539663861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:05 devstack sudo[91631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:45:05 devstack sudo[91631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:05 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5d9009e2-b988-496f-a213-5cf133ff4c57 tempest-AbsoluteLimitsTests-454722278 None] Acquiring lock "cinder-quobyte-14df9f07-9b8b-48d1-9797-2d814045706a" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:05 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5d9009e2-b988-496f-a213-5cf133ff4c57 tempest-AbsoluteLimitsTests-454722278 None] Lock "cinder-quobyte-14df9f07-9b8b-48d1-9797-2d814045706a" acquired by "delete_volume" :: waited 0.019s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:05 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf12512d-a955-4f34-a156-c26d9c05ae65]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:45:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5d9009e2-b988-496f-a213-5cf133ff4c57 tempest-AbsoluteLimitsTests-454722278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14df9f07-9b8b-48d1-9797-2d814045706a {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:06 devstack sudo[91633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14df9f07-9b8b-48d1-9797-2d814045706a Apr 29 06:45:06 devstack sudo[91633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:06 devstack sudo[91629]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7" returned: 0 in 0.657s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:06 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:45:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676b8489-4ddc-439a-9076-46c2c30c9d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (005012dd-cea1-42d9-bd55-252603345a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:06 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Volume volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7 (e6f41dea-11e3-4e4c-b8bd-6873ee1680d7): created successfully Apr 29 06:45:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (005012dd-cea1-42d9-bd55-252603345a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Flow 'volume_create_manager' (fd66fe3f-1d11-479f-91ad-09defd797e22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:45:06 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-d21804bc-ca08-4235-9951-5d73a12f6eac tempest-VolumesSnapshotTestJSON-917607631 None] Created volume successfully. Apr 29 06:45:06 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2f4d5073-fb6a-47ea-b0f1-2855eba0b163 tempest-VolumesCloneTest-1539663861 None] Acquiring lock "cinder-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:06 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2f4d5073-fb6a-47ea-b0f1-2855eba0b163 tempest-VolumesCloneTest-1539663861 None] Lock "cinder-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:06 devstack sudo[91631]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bd5e9e61-bb4f-43d1-97ef-34cd94abfa6a tempest-VolumesCloneTest-1539663861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.681s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:06 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-bd5e9e61-bb4f-43d1-97ef-34cd94abfa6a tempest-VolumesCloneTest-1539663861 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:45:06 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-bd5e9e61-bb4f-43d1-97ef-34cd94abfa6a tempest-VolumesCloneTest-1539663861 None] Deleted volume successfully. Apr 29 06:45:06 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2f4d5073-fb6a-47ea-b0f1-2855eba0b163 tempest-VolumesCloneTest-1539663861 None] Acquiring lock "cinder-quobyte-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:06 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-bd5e9e61-bb4f-43d1-97ef-34cd94abfa6a tempest-VolumesCloneTest-1539663861 None] Lock "cinder-d08c3db3-115e-485f-83ff-b309c4cce2a4-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:06 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2f4d5073-fb6a-47ea-b0f1-2855eba0b163 tempest-VolumesCloneTest-1539663861 None] Lock "cinder-quobyte-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690" acquired by "delete_volume" :: waited 0.026s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:06 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc95219-955f-4c6b-b011-c34b99b922a9]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:45:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2f4d5073-fb6a-47ea-b0f1-2855eba0b163 tempest-VolumesCloneTest-1539663861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:06 devstack sudo[91638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 Apr 29 06:45:06 devstack sudo[91638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:06 devstack sudo[91633]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5d9009e2-b988-496f-a213-5cf133ff4c57 tempest-AbsoluteLimitsTests-454722278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14df9f07-9b8b-48d1-9797-2d814045706a" returned: 0 in 0.837s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5d9009e2-b988-496f-a213-5cf133ff4c57 tempest-AbsoluteLimitsTests-454722278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14df9f07-9b8b-48d1-9797-2d814045706a {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:06 devstack sudo[91643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14df9f07-9b8b-48d1-9797-2d814045706a Apr 29 06:45:06 devstack sudo[91643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:07 devstack sudo[91643]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5d9009e2-b988-496f-a213-5cf133ff4c57 tempest-AbsoluteLimitsTests-454722278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14df9f07-9b8b-48d1-9797-2d814045706a" returned: 0 in 0.608s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:07 devstack sudo[91638]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2f4d5073-fb6a-47ea-b0f1-2855eba0b163 tempest-VolumesCloneTest-1539663861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690" returned: 0 in 0.768s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2f4d5073-fb6a-47ea-b0f1-2855eba0b163 tempest-VolumesCloneTest-1539663861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:07 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5d9009e2-b988-496f-a213-5cf133ff4c57 tempest-AbsoluteLimitsTests-454722278 None] Lock "cinder-quobyte-14df9f07-9b8b-48d1-9797-2d814045706a" released by "delete_volume" :: held 1.496s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:07 devstack sudo[91649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690 Apr 29 06:45:07 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:07 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-5d9009e2-b988-496f-a213-5cf133ff4c57 tempest-AbsoluteLimitsTests-454722278 None] Created reservations ['18d2050f-590e-43c3-88d6-4ff9b462cb2f', '93104c28-119c-4c8c-af80-e27ded6260c6', '329d0037-e790-4e17-8fd4-597a98b36049', '5b7819b8-9622-4ce0-9bb1-044f7fad2153'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:45:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5d9009e2-b988-496f-a213-5cf133ff4c57 tempest-AbsoluteLimitsTests-454722278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5d9009e2-b988-496f-a213-5cf133ff4c57 tempest-AbsoluteLimitsTests-454722278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:07 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5d9009e2-b988-496f-a213-5cf133ff4c57 tempest-AbsoluteLimitsTests-454722278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:45:07 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5d9009e2-b988-496f-a213-5cf133ff4c57 tempest-AbsoluteLimitsTests-454722278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:45:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5d9009e2-b988-496f-a213-5cf133ff4c57 tempest-AbsoluteLimitsTests-454722278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5d9009e2-b988-496f-a213-5cf133ff4c57 tempest-AbsoluteLimitsTests-454722278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:07 devstack sudo[91651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:45:07 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-49087372-8e23-4011-b7ad-632f09217198 tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-49087372-8e23-4011-b7ad-632f09217198 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:07 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-49087372-8e23-4011-b7ad-632f09217198 tempest-VolumesSnapshotTestJSON-917607631 None] Creating offline snapshot 32712efe-15ff-479c-a966-b5b926e0448b of volume e6f41dea-11e3-4e4c-b8bd-6873ee1680d7 {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:45:07 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7a139a-7af4-4aa0-b7c6-9310c72ae067]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:45:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-49087372-8e23-4011-b7ad-632f09217198 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:07 devstack sudo[91653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7 Apr 29 06:45:07 devstack sudo[91653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:08 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2f4d5073-fb6a-47ea-b0f1-2855eba0b163 tempest-VolumesCloneTest-1539663861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690" returned: 0 in 0.717s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:08 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2f4d5073-fb6a-47ea-b0f1-2855eba0b163 tempest-VolumesCloneTest-1539663861 None] Lock "cinder-quobyte-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690" released by "delete_volume" :: held 1.556s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:08 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-2f4d5073-fb6a-47ea-b0f1-2855eba0b163 tempest-VolumesCloneTest-1539663861 None] Created reservations ['c965b5b3-9f6e-49fb-b6aa-1ca9105e3918', '613083fd-51c0-41f3-889e-617e43d22098', '19cb6d21-0ff2-47cf-9ff6-43114b508dd9', '4c721b22-5689-4dbc-ad58-55e9ec42bef5'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:45:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2f4d5073-fb6a-47ea-b0f1-2855eba0b163 tempest-VolumesCloneTest-1539663861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2f4d5073-fb6a-47ea-b0f1-2855eba0b163 tempest-VolumesCloneTest-1539663861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2f4d5073-fb6a-47ea-b0f1-2855eba0b163 tempest-VolumesCloneTest-1539663861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:45:08 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2f4d5073-fb6a-47ea-b0f1-2855eba0b163 tempest-VolumesCloneTest-1539663861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:45:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2f4d5073-fb6a-47ea-b0f1-2855eba0b163 tempest-VolumesCloneTest-1539663861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2f4d5073-fb6a-47ea-b0f1-2855eba0b163 tempest-VolumesCloneTest-1539663861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5d9009e2-b988-496f-a213-5cf133ff4c57 tempest-AbsoluteLimitsTests-454722278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.773s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:08 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-5d9009e2-b988-496f-a213-5cf133ff4c57 tempest-AbsoluteLimitsTests-454722278 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:45:08 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-5d9009e2-b988-496f-a213-5cf133ff4c57 tempest-AbsoluteLimitsTests-454722278 None] Deleted volume successfully. Apr 29 06:45:08 devstack sudo[91657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:45:08 devstack sudo[91657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:08 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5d9009e2-b988-496f-a213-5cf133ff4c57 tempest-AbsoluteLimitsTests-454722278 None] Lock "cinder-14df9f07-9b8b-48d1-9797-2d814045706a-delete_volume" released by "delete_volume" :: held 2.522s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:08 devstack sudo[91653]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-49087372-8e23-4011-b7ad-632f09217198 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7" returned: 0 in 0.767s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-49087372-8e23-4011-b7ad-632f09217198 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.32712efe-15ff-479c-a966-b5b926e0448b 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:08 devstack sudo[91662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.32712efe-15ff-479c-a966-b5b926e0448b 1G Apr 29 06:45:08 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:08 devstack sudo[91657]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2f4d5073-fb6a-47ea-b0f1-2855eba0b163 tempest-VolumesCloneTest-1539663861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.717s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:08 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-2f4d5073-fb6a-47ea-b0f1-2855eba0b163 tempest-VolumesCloneTest-1539663861 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:45:08 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-2f4d5073-fb6a-47ea-b0f1-2855eba0b163 tempest-VolumesCloneTest-1539663861 None] Deleted volume successfully. Apr 29 06:45:09 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2f4d5073-fb6a-47ea-b0f1-2855eba0b163 tempest-VolumesCloneTest-1539663861 None] Lock "cinder-a1f0e1ad-dde3-4996-9d3c-b3c6edb65690-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:09 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-49087372-8e23-4011-b7ad-632f09217198 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.32712efe-15ff-479c-a966-b5b926e0448b 1G" returned: 0 in 0.999s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-49087372-8e23-4011-b7ad-632f09217198 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.32712efe-15ff-479c-a966-b5b926e0448b {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:09 devstack sudo[91669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.32712efe-15ff-479c-a966-b5b926e0448b Apr 29 06:45:09 devstack sudo[91669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:10 devstack sudo[91669]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-49087372-8e23-4011-b7ad-632f09217198 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.32712efe-15ff-479c-a966-b5b926e0448b" returned: 0 in 0.932s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:10 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-49087372-8e23-4011-b7ad-632f09217198 tempest-VolumesSnapshotTestJSON-917607631 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.32712efe-15ff-479c-a966-b5b926e0448b is being set with open permissions: ugo+rw Apr 29 06:45:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-49087372-8e23-4011-b7ad-632f09217198 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.32712efe-15ff-479c-a966-b5b926e0448b {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:10 devstack sudo[91675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.32712efe-15ff-479c-a966-b5b926e0448b Apr 29 06:45:10 devstack sudo[91675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:11 devstack sudo[91675]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-49087372-8e23-4011-b7ad-632f09217198 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.32712efe-15ff-479c-a966-b5b926e0448b" returned: 0 in 0.659s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-49087372-8e23-4011-b7ad-632f09217198 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:11 devstack sudo[91678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.info Apr 29 06:45:11 devstack sudo[91678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:11 devstack sudo[91678]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-49087372-8e23-4011-b7ad-632f09217198 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.info" returned: 0 in 0.688s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:11 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-49087372-8e23-4011-b7ad-632f09217198 tempest-VolumesSnapshotTestJSON-917607631 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.info is being set with open permissions: ugo+rw Apr 29 06:45:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-49087372-8e23-4011-b7ad-632f09217198 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:11 devstack sudo[91681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.info Apr 29 06:45:11 devstack sudo[91681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:12 devstack sudo[91681]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-49087372-8e23-4011-b7ad-632f09217198 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.info" returned: 0 in 0.673s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-49087372-8e23-4011-b7ad-632f09217198 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.820s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:12 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-49087372-8e23-4011-b7ad-632f09217198 tempest-VolumesSnapshotTestJSON-917607631 None] Create snapshot completed successfully Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Flow 'volume_create_manager' (7d45aa63-96b0-4136-9136-bc4e1b86599e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c00dee-5501-4f80-b511-2424d4cd5a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c00dee-5501-4f80-b511-2424d4cd5a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1109091002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b5d47c-9449-4f9f-bdf3-a53884ebd808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e37e8c2a947444f9c90642a08cfb2fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=32712efe-15ff-479c-a966-b5b926e0448b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:45:13Z,use_quota=True,user_id='fb914768d2944715bbeff26f818adc68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb43345-fe5a-41e9-a4c2-91cd246aee25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb43345-fe5a-41e9-a4c2-91cd246aee25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7597c741-439f-43a2-837c-121be3d20b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7597c741-439f-43a2-837c-121be3d20b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '52b5d47c-9449-4f9f-bdf3-a53884ebd808', 'volume_name': 'volume-52b5d47c-9449-4f9f-bdf3-a53884ebd808', 'volume_size': 1, 'snapshot_id': '32712efe-15ff-479c-a966-b5b926e0448b'}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8704b8-4e4c-4abb-9539-8c4443968864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8704b8-4e4c-4abb-9539-8c4443968864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a7afac-f8c3-4e88-9278-2ad217dd18ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:13 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Volume 52b5d47c-9449-4f9f-bdf3-a53884ebd808: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-52b5d47c-9449-4f9f-bdf3-a53884ebd808', 'volume_size': 1, 'snapshot_id': '32712efe-15ff-479c-a966-b5b926e0448b'} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "cinder-quobyte-32712efe-15ff-479c-a966-b5b926e0448b-52b5d47c-9449-4f9f-bdf3-a53884ebd808" by "_create_volume_from_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-32712efe-15ff-479c-a966-b5b926e0448b-52b5d47c-9449-4f9f-bdf3-a53884ebd808" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Creating volume 52b5d47c-9449-4f9f-bdf3-a53884ebd808 from snapshot 32712efe-15ff-479c-a966-b5b926e0448b {{(pid=84195) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "cinder-quobyte-52b5d47c-9449-4f9f-bdf3-a53884ebd808" by "_copy_volume_from_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-52b5d47c-9449-4f9f-bdf3-a53884ebd808" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] snapshot: 32712efe-15ff-479c-a966-b5b926e0448b, volume: 52b5d47c-9449-4f9f-bdf3-a53884ebd808, {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7d5724-a3ea-4068-900b-42efa10e7cec]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:45:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.32712efe-15ff-479c-a966-b5b926e0448b {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:13 devstack sudo[91684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.32712efe-15ff-479c-a966-b5b926e0448b Apr 29 06:45:13 devstack sudo[91684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:14 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:45:14 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Flow 'volume_create_manager' (ee50d9aa-144c-4264-8c7c-724944fbace3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:45:14 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5eaf9a9-8c3e-4d39-80ab-2c944a51589b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:14 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5eaf9a9-8c3e-4d39-80ab-2c944a51589b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2055475032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=262160f3-f35c-4576-8682-782a910d1d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d213297b3ba24866ab1733f2ed4912e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:45:14Z,use_quota=True,user_id='548eef50c88e4b009153f5dad0a34bd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:14 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (611b1ee0-6443-4fc0-9cce-53872a3aa9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:14 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (611b1ee0-6443-4fc0-9cce-53872a3aa9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:14 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f51c0702-9c08-461d-82f4-fa759fb90e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:14 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f51c0702-9c08-461d-82f4-fa759fb90e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '262160f3-f35c-4576-8682-782a910d1d59', 'volume_name': 'volume-262160f3-f35c-4576-8682-782a910d1d59', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:14 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da38106-7e4b-4f5e-b4c4-6e51c63be8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:14 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da38106-7e4b-4f5e-b4c4-6e51c63be8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:14 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d308370-bbe0-495c-a0f4-24873ce1fd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:14 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Volume 262160f3-f35c-4576-8682-782a910d1d59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-262160f3-f35c-4576-8682-782a910d1d59', 'volume_size': 1} Apr 29 06:45:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:14 devstack sudo[91684]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.32712efe-15ff-479c-a966-b5b926e0448b" returned: 0 in 0.844s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:14 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:45:14 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7 {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 06:45:14 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Creating direct copy from snapshot {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 06:45:14 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4634772-bc36-4d5f-b225-5e0e3f202e61]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:45:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:14 devstack sudo[91689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7 Apr 29 06:45:14 devstack sudo[91689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:15 devstack sudo[91689]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7" returned: 0 in 0.741s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:15 devstack cinder-volume[84195]: DEBUG cinder.utils [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Path /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-52b5d47c-9449-4f9f-bdf3-a53884ebd808 not found in is_blk_device check {{(pid=84195) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 06:45:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-52b5d47c-9449-4f9f-bdf3-a53884ebd808 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:15 devstack sudo[91694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-52b5d47c-9449-4f9f-bdf3-a53884ebd808 Apr 29 06:45:15 devstack sudo[91694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:18 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:SELECT=101,cinder:UPDATE=101,cinder:INSERT=41,cinder:DELETE=11 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:45:18 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:UPDATE=119,cinder:SELECT=97,cinder:INSERT=25,cinder:DELETE=9 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:45:20 devstack sudo[91694]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-52b5d47c-9449-4f9f-bdf3-a53884ebd808" returned: 0 in 5.499s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:20 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[da74a659-0d8f-47d5-b796-c4b522639411]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:45:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:20 devstack sudo[91709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7 Apr 29 06:45:20 devstack sudo[91709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:21 devstack sudo[91709]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7" returned: 0 in 0.953s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:21 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Image conversion details: src /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7, size 1024.00 MB, duration 5.50 sec, destination /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-52b5d47c-9449-4f9f-bdf3-a53884ebd808 {{(pid=84195) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 06:45:21 devstack cinder-volume[84195]: INFO cinder.image.image_utils [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Converted 1024.00 MB image at 186.19 MB/s Apr 29 06:45:21 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-52b5d47c-9449-4f9f-bdf3-a53884ebd808 is being set with open permissions: ugo+rw Apr 29 06:45:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-52b5d47c-9449-4f9f-bdf3-a53884ebd808 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:21 devstack sudo[91715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-52b5d47c-9449-4f9f-bdf3-a53884ebd808 Apr 29 06:45:21 devstack sudo[91715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:22 devstack sudo[91715]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-52b5d47c-9449-4f9f-bdf3-a53884ebd808" returned: 0 in 0.649s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:22 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-52b5d47c-9449-4f9f-bdf3-a53884ebd808" released by "_copy_volume_from_snapshot" :: held 8.791s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:22 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-32712efe-15ff-479c-a966-b5b926e0448b-52b5d47c-9449-4f9f-bdf3-a53884ebd808" released by "_create_volume_from_snapshot" :: held 8.828s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.847s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2055475032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=262160f3-f35c-4576-8682-782a910d1d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d213297b3ba24866ab1733f2ed4912e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:45:14Z,use_quota=True,user_id='548eef50c88e4b009153f5dad0a34bd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:45:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Creating volume 262160f3-f35c-4576-8682-782a910d1d59 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:45:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:45:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:45:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:45:22 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:45:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-262160f3-f35c-4576-8682-782a910d1d59 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:22 devstack sudo[91718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-262160f3-f35c-4576-8682-782a910d1d59 1073741824 Apr 29 06:45:22 devstack sudo[91718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a7afac-f8c3-4e88-9278-2ad217dd18ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52b5d47c-9449-4f9f-bdf3-a53884ebd808', 'volume_size': 1, 'snapshot_id': '32712efe-15ff-479c-a966-b5b926e0448b'}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a07428e-2a70-4570-b593-c8d94512bdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:22 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Volume volume-52b5d47c-9449-4f9f-bdf3-a53884ebd808 (52b5d47c-9449-4f9f-bdf3-a53884ebd808): created successfully Apr 29 06:45:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a07428e-2a70-4570-b593-c8d94512bdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Flow 'volume_create_manager' (7d45aa63-96b0-4136-9136-bc4e1b86599e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:45:22 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-89aaf11d-d0a6-43b8-a6a9-b03bd38def4f tempest-VolumesSnapshotTestJSON-917607631 None] Created volume successfully. Apr 29 06:45:23 devstack sudo[91718]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-262160f3-f35c-4576-8682-782a910d1d59 1073741824" returned: 0 in 0.828s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-262160f3-f35c-4576-8682-782a910d1d59 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:23 devstack sudo[91724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-262160f3-f35c-4576-8682-782a910d1d59 Apr 29 06:45:23 devstack sudo[91724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:23 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4a56d498-6715-4577-80ca-2cef8ea6609b tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "cinder-52b5d47c-9449-4f9f-bdf3-a53884ebd808-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:23 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4a56d498-6715-4577-80ca-2cef8ea6609b tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-52b5d47c-9449-4f9f-bdf3-a53884ebd808-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:23 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4a56d498-6715-4577-80ca-2cef8ea6609b tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "cinder-quobyte-52b5d47c-9449-4f9f-bdf3-a53884ebd808" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:23 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4a56d498-6715-4577-80ca-2cef8ea6609b tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-52b5d47c-9449-4f9f-bdf3-a53884ebd808" acquired by "delete_volume" :: waited 0.017s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:23 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[a029c920-a813-4e18-aac8-3ecbd5075ec3]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:45:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4a56d498-6715-4577-80ca-2cef8ea6609b tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-52b5d47c-9449-4f9f-bdf3-a53884ebd808 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:23 devstack sudo[91726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-52b5d47c-9449-4f9f-bdf3-a53884ebd808 Apr 29 06:45:23 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:24 devstack sudo[91724]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-262160f3-f35c-4576-8682-782a910d1d59" returned: 0 in 0.694s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:24 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:45:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:24 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d308370-bbe0-495c-a0f4-24873ce1fd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-262160f3-f35c-4576-8682-782a910d1d59', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:24 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88c65e57-1804-4296-abde-5e14ef30f88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:24 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Volume volume-262160f3-f35c-4576-8682-782a910d1d59 (262160f3-f35c-4576-8682-782a910d1d59): created successfully Apr 29 06:45:24 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88c65e57-1804-4296-abde-5e14ef30f88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:24 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Flow 'volume_create_manager' (ee50d9aa-144c-4264-8c7c-724944fbace3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:45:24 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-11cd3e7d-6043-4b55-a473-f462c5343ac6 tempest-VolumesTransfersTest-2080970073 None] Created volume successfully. Apr 29 06:45:24 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4a56d498-6715-4577-80ca-2cef8ea6609b tempest-VolumesSnapshotTestJSON-917607631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-52b5d47c-9449-4f9f-bdf3-a53884ebd808" returned: 0 in 0.823s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4a56d498-6715-4577-80ca-2cef8ea6609b tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-52b5d47c-9449-4f9f-bdf3-a53884ebd808 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:24 devstack sudo[91732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-52b5d47c-9449-4f9f-bdf3-a53884ebd808 Apr 29 06:45:24 devstack sudo[91732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:25 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-01d0da0a-3c22-45c3-a0bc-2b529ff6b62a tempest-VolumesTransfersTest-298339953 None] Transfer volume completed successfully. Apr 29 06:45:25 devstack sudo[91732]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4a56d498-6715-4577-80ca-2cef8ea6609b tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-52b5d47c-9449-4f9f-bdf3-a53884ebd808" returned: 0 in 0.893s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:25 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4a56d498-6715-4577-80ca-2cef8ea6609b tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-52b5d47c-9449-4f9f-bdf3-a53884ebd808" released by "delete_volume" :: held 1.760s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:25 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-4a56d498-6715-4577-80ca-2cef8ea6609b tempest-VolumesSnapshotTestJSON-917607631 None] Created reservations ['bc11c5a6-cebf-4fb6-822f-4f53d96e38f1', '80d59b00-bdad-4d62-8899-88d7413c14ae', 'b1f1f743-44f0-4786-be69-8b787c6849ac', 'd5470385-9ef6-44d3-acbe-312efa629d89'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:45:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4a56d498-6715-4577-80ca-2cef8ea6609b tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4a56d498-6715-4577-80ca-2cef8ea6609b tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:25 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4a56d498-6715-4577-80ca-2cef8ea6609b tempest-VolumesSnapshotTestJSON-917607631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:45:25 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4a56d498-6715-4577-80ca-2cef8ea6609b tempest-VolumesSnapshotTestJSON-917607631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:45:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4a56d498-6715-4577-80ca-2cef8ea6609b tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4a56d498-6715-4577-80ca-2cef8ea6609b tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:25 devstack sudo[91771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:45:25 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:25 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-63d2683f-3b0c-498a-a321-5b12b52986cd tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "cinder-32712efe-15ff-479c-a966-b5b926e0448b-delete_snapshot" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:25 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-63d2683f-3b0c-498a-a321-5b12b52986cd tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-32712efe-15ff-479c-a966-b5b926e0448b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:25 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-63d2683f-3b0c-498a-a321-5b12b52986cd tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "cinder-quobyte-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:25 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-63d2683f-3b0c-498a-a321-5b12b52986cd tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7" acquired by "delete_snapshot" :: waited 0.035s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:25 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-63d2683f-3b0c-498a-a321-5b12b52986cd tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "cinder-quobyte-32712efe-15ff-479c-a966-b5b926e0448b" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:26 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-63d2683f-3b0c-498a-a321-5b12b52986cd tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-32712efe-15ff-479c-a966-b5b926e0448b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:26 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-63d2683f-3b0c-498a-a321-5b12b52986cd tempest-VolumesSnapshotTestJSON-917607631 None] Deleting offline snapshot 32712efe-15ff-479c-a966-b5b926e0448b of volume e6f41dea-11e3-4e4c-b8bd-6873ee1680d7 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:45:26 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-63d2683f-3b0c-498a-a321-5b12b52986cd tempest-VolumesSnapshotTestJSON-917607631 None] snapshot_file for this snap is: volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.32712efe-15ff-479c-a966-b5b926e0448b {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:45:26 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[b839f1d4-06e2-4581-99a7-26961d548041]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:45:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-63d2683f-3b0c-498a-a321-5b12b52986cd tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.32712efe-15ff-479c-a966-b5b926e0448b {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:26 devstack sudo[91773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.32712efe-15ff-479c-a966-b5b926e0448b Apr 29 06:45:26 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:26 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4a56d498-6715-4577-80ca-2cef8ea6609b tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.754s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:26 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-4a56d498-6715-4577-80ca-2cef8ea6609b tempest-VolumesSnapshotTestJSON-917607631 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:45:26 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-4a56d498-6715-4577-80ca-2cef8ea6609b tempest-VolumesSnapshotTestJSON-917607631 None] Deleted volume successfully. Apr 29 06:45:26 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4a56d498-6715-4577-80ca-2cef8ea6609b tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-52b5d47c-9449-4f9f-bdf3-a53884ebd808-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:26 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-aa9d9b75-97ea-4fb8-95d9-51ae803a615a tempest-VolumesTransfersTest-1375746525 None] Acquiring lock "cinder-262160f3-f35c-4576-8682-782a910d1d59-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:26 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-aa9d9b75-97ea-4fb8-95d9-51ae803a615a tempest-VolumesTransfersTest-1375746525 None] Lock "cinder-262160f3-f35c-4576-8682-782a910d1d59-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:26 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-aa9d9b75-97ea-4fb8-95d9-51ae803a615a tempest-VolumesTransfersTest-1375746525 None] Acquiring lock "cinder-quobyte-262160f3-f35c-4576-8682-782a910d1d59" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:26 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-aa9d9b75-97ea-4fb8-95d9-51ae803a615a tempest-VolumesTransfersTest-1375746525 None] Lock "cinder-quobyte-262160f3-f35c-4576-8682-782a910d1d59" acquired by "delete_volume" :: waited 0.019s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:26 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bccd89-6459-496a-9bfc-439ae6e72c51]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:45:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-aa9d9b75-97ea-4fb8-95d9-51ae803a615a tempest-VolumesTransfersTest-1375746525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-262160f3-f35c-4576-8682-782a910d1d59 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:26 devstack sudo[91777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-262160f3-f35c-4576-8682-782a910d1d59 Apr 29 06:45:26 devstack sudo[91777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:26 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-63d2683f-3b0c-498a-a321-5b12b52986cd tempest-VolumesSnapshotTestJSON-917607631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.32712efe-15ff-479c-a966-b5b926e0448b" returned: 0 in 0.876s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:26 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-63d2683f-3b0c-498a-a321-5b12b52986cd tempest-VolumesSnapshotTestJSON-917607631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:45:26 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[842e5fd5-4e8f-42df-9955-9903e6a8feca]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:45:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-63d2683f-3b0c-498a-a321-5b12b52986cd tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:27 devstack sudo[91782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7 Apr 29 06:45:27 devstack sudo[91782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:27 devstack sudo[91777]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-aa9d9b75-97ea-4fb8-95d9-51ae803a615a tempest-VolumesTransfersTest-1375746525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-262160f3-f35c-4576-8682-782a910d1d59" returned: 0 in 0.840s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-aa9d9b75-97ea-4fb8-95d9-51ae803a615a tempest-VolumesTransfersTest-1375746525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-262160f3-f35c-4576-8682-782a910d1d59 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:27 devstack sudo[91787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-262160f3-f35c-4576-8682-782a910d1d59 Apr 29 06:45:27 devstack sudo[91787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:27 devstack sudo[91782]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-63d2683f-3b0c-498a-a321-5b12b52986cd tempest-VolumesSnapshotTestJSON-917607631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7" returned: 0 in 0.745s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-63d2683f-3b0c-498a-a321-5b12b52986cd tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.32712efe-15ff-479c-a966-b5b926e0448b {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:27 devstack sudo[91793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.32712efe-15ff-479c-a966-b5b926e0448b Apr 29 06:45:27 devstack sudo[91793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:28 devstack sudo[91787]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-aa9d9b75-97ea-4fb8-95d9-51ae803a615a tempest-VolumesTransfersTest-1375746525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-262160f3-f35c-4576-8682-782a910d1d59" returned: 0 in 0.679s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:28 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-aa9d9b75-97ea-4fb8-95d9-51ae803a615a tempest-VolumesTransfersTest-1375746525 None] Lock "cinder-quobyte-262160f3-f35c-4576-8682-782a910d1d59" released by "delete_volume" :: held 1.562s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:28 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-aa9d9b75-97ea-4fb8-95d9-51ae803a615a tempest-VolumesTransfersTest-1375746525 None] Created reservations ['69566c7c-472b-4b7d-bae8-353fde88871c', '6f5b8e37-4c61-49c6-9338-2309f1cbb2d0', '49381674-d958-4a8d-a9b3-dd9ab4033717', 'fd301507-2b86-49dc-8fcf-645d5669f090'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:45:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-aa9d9b75-97ea-4fb8-95d9-51ae803a615a tempest-VolumesTransfersTest-1375746525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-aa9d9b75-97ea-4fb8-95d9-51ae803a615a tempest-VolumesTransfersTest-1375746525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:28 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-aa9d9b75-97ea-4fb8-95d9-51ae803a615a tempest-VolumesTransfersTest-1375746525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:45:28 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-aa9d9b75-97ea-4fb8-95d9-51ae803a615a tempest-VolumesTransfersTest-1375746525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:45:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-aa9d9b75-97ea-4fb8-95d9-51ae803a615a tempest-VolumesTransfersTest-1375746525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-aa9d9b75-97ea-4fb8-95d9-51ae803a615a tempest-VolumesTransfersTest-1375746525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:28 devstack sudo[91799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:45:28 devstack sudo[91799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:28 devstack sudo[91793]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-63d2683f-3b0c-498a-a321-5b12b52986cd tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.32712efe-15ff-479c-a966-b5b926e0448b" returned: 0 in 0.757s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-63d2683f-3b0c-498a-a321-5b12b52986cd tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.32712efe-15ff-479c-a966-b5b926e0448b {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:28 devstack sudo[91801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.32712efe-15ff-479c-a966-b5b926e0448b Apr 29 06:45:28 devstack sudo[91801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:28 devstack sudo[91799]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-aa9d9b75-97ea-4fb8-95d9-51ae803a615a tempest-VolumesTransfersTest-1375746525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.659s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:28 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-aa9d9b75-97ea-4fb8-95d9-51ae803a615a tempest-VolumesTransfersTest-1375746525 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:45:29 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-aa9d9b75-97ea-4fb8-95d9-51ae803a615a tempest-VolumesTransfersTest-1375746525 None] Deleted volume successfully. Apr 29 06:45:29 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-aa9d9b75-97ea-4fb8-95d9-51ae803a615a tempest-VolumesTransfersTest-1375746525 None] Lock "cinder-262160f3-f35c-4576-8682-782a910d1d59-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:29 devstack sudo[91801]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-63d2683f-3b0c-498a-a321-5b12b52986cd tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7.32712efe-15ff-479c-a966-b5b926e0448b" returned: 0 in 0.737s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:29 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-63d2683f-3b0c-498a-a321-5b12b52986cd tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-32712efe-15ff-479c-a966-b5b926e0448b" released by "_delete_snapshot" :: held 3.270s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:29 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-63d2683f-3b0c-498a-a321-5b12b52986cd tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7" released by "delete_snapshot" :: held 3.304s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:29 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:45:29 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Flow 'volume_create_manager' (386f7d67-017a-4c53-858c-2faf759adcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:45:29 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a62e11a-b716-4ae7-9d9b-b1e4bb62d216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:29 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a62e11a-b716-4ae7-9d9b-b1e4bb62d216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1391598647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=930a9020-56de-4783-901e-2236c04df3cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d213297b3ba24866ab1733f2ed4912e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:45:29Z,use_quota=True,user_id='548eef50c88e4b009153f5dad0a34bd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:29 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a37bd9b-4335-4719-a64b-7be132d0da87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:29 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a37bd9b-4335-4719-a64b-7be132d0da87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:29 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240d65c5-b784-4463-b009-7c369bcad584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:29 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240d65c5-b784-4463-b009-7c369bcad584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '930a9020-56de-4783-901e-2236c04df3cf', 'volume_name': 'volume-930a9020-56de-4783-901e-2236c04df3cf', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:29 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37d4ba2-003f-473d-a679-21572119cf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:29 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37d4ba2-003f-473d-a679-21572119cf06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:29 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4e6be2-60da-407f-9452-65b9511a7513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:29 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Volume 930a9020-56de-4783-901e-2236c04df3cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-930a9020-56de-4783-901e-2236c04df3cf', 'volume_size': 1} Apr 29 06:45:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:29 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1391598647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=930a9020-56de-4783-901e-2236c04df3cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d213297b3ba24866ab1733f2ed4912e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:45:29Z,use_quota=True,user_id='548eef50c88e4b009153f5dad0a34bd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:45:29 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Creating volume 930a9020-56de-4783-901e-2236c04df3cf {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:45:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:29 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:45:29 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:45:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:29 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:45:29 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:45:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-930a9020-56de-4783-901e-2236c04df3cf 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:29 devstack sudo[91805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-930a9020-56de-4783-901e-2236c04df3cf 1073741824 Apr 29 06:45:29 devstack sudo[91805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:29 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-63d2683f-3b0c-498a-a321-5b12b52986cd tempest-VolumesSnapshotTestJSON-917607631 None] Created reservations ['cbdf3746-f62b-4066-9bad-b305ea9dcac6', '21f0bdc0-6ebc-4581-8cd4-be4e7593a2e0', '146d0f55-0023-4597-aa67-8fe35315e1b7', '6a7c54f0-cf27-4d38-9385-901471ac393c'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:45:29 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-63d2683f-3b0c-498a-a321-5b12b52986cd tempest-VolumesSnapshotTestJSON-917607631 None] Delete snapshot completed successfully. Apr 29 06:45:29 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-63d2683f-3b0c-498a-a321-5b12b52986cd tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-32712efe-15ff-479c-a966-b5b926e0448b-delete_snapshot" released by "delete_snapshot" :: held 3.575s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:30 devstack sudo[91805]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-930a9020-56de-4783-901e-2236c04df3cf 1073741824" returned: 0 in 0.814s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:30 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-56d7966f-7979-473c-b44a-ee6766396a30 tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "cinder-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:30 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-56d7966f-7979-473c-b44a-ee6766396a30 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-930a9020-56de-4783-901e-2236c04df3cf {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:30 devstack sudo[91810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-930a9020-56de-4783-901e-2236c04df3cf Apr 29 06:45:30 devstack sudo[91810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:30 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-56d7966f-7979-473c-b44a-ee6766396a30 tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "cinder-quobyte-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:30 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-56d7966f-7979-473c-b44a-ee6766396a30 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7" acquired by "delete_volume" :: waited 0.019s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:30 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a4298e-63ac-4914-8115-560ecfa8e4c5]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:45:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-56d7966f-7979-473c-b44a-ee6766396a30 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:30 devstack sudo[91812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7 Apr 29 06:45:30 devstack sudo[91812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:30 devstack sudo[91810]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-930a9020-56de-4783-901e-2236c04df3cf" returned: 0 in 0.646s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:30 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:45:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:30 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4e6be2-60da-407f-9452-65b9511a7513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-930a9020-56de-4783-901e-2236c04df3cf', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:30 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a95f62-b85e-4f37-98b7-5e716c64fb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:30 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Volume volume-930a9020-56de-4783-901e-2236c04df3cf (930a9020-56de-4783-901e-2236c04df3cf): created successfully Apr 29 06:45:30 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a95f62-b85e-4f37-98b7-5e716c64fb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:30 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Flow 'volume_create_manager' (386f7d67-017a-4c53-858c-2faf759adcfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:45:31 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-c234eb93-8d29-4a6e-a36f-4d354bd4eb87 tempest-VolumesTransfersTest-2080970073 None] Created volume successfully. Apr 29 06:45:31 devstack sudo[91812]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-56d7966f-7979-473c-b44a-ee6766396a30 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7" returned: 0 in 0.835s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-56d7966f-7979-473c-b44a-ee6766396a30 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:31 devstack sudo[91818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7 Apr 29 06:45:31 devstack sudo[91818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:31 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4378710c-1e41-4b98-9044-f40d0dca2b0f tempest-VolumesTransfersTest-1375746525 None] Acquiring lock "cinder-930a9020-56de-4783-901e-2236c04df3cf-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:31 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4378710c-1e41-4b98-9044-f40d0dca2b0f tempest-VolumesTransfersTest-1375746525 None] Lock "cinder-930a9020-56de-4783-901e-2236c04df3cf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:31 devstack sudo[91818]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-56d7966f-7979-473c-b44a-ee6766396a30 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7" returned: 0 in 0.653s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:31 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-56d7966f-7979-473c-b44a-ee6766396a30 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7" released by "delete_volume" :: held 1.579s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:31 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4378710c-1e41-4b98-9044-f40d0dca2b0f tempest-VolumesTransfersTest-1375746525 None] Acquiring lock "cinder-quobyte-930a9020-56de-4783-901e-2236c04df3cf" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:32 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4378710c-1e41-4b98-9044-f40d0dca2b0f tempest-VolumesTransfersTest-1375746525 None] Lock "cinder-quobyte-930a9020-56de-4783-901e-2236c04df3cf" acquired by "delete_volume" :: waited 0.026s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:32 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-56d7966f-7979-473c-b44a-ee6766396a30 tempest-VolumesSnapshotTestJSON-917607631 None] Created reservations ['ca64bc23-180f-4d61-85b7-3ed4f5df01eb', 'd4e57fcc-2f05-4aa6-86c4-747655921e66', '9829bdcf-d36e-462a-987d-71d87c1f9f67', 'f6c5798b-5f4c-4675-ae08-784c2dd7ead6'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:45:32 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2392cd-d437-48d7-a9ef-16f2c4565af0]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:45:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4378710c-1e41-4b98-9044-f40d0dca2b0f tempest-VolumesTransfersTest-1375746525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-930a9020-56de-4783-901e-2236c04df3cf {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-56d7966f-7979-473c-b44a-ee6766396a30 tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-56d7966f-7979-473c-b44a-ee6766396a30 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:32 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-56d7966f-7979-473c-b44a-ee6766396a30 tempest-VolumesSnapshotTestJSON-917607631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:45:32 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-56d7966f-7979-473c-b44a-ee6766396a30 tempest-VolumesSnapshotTestJSON-917607631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:45:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-56d7966f-7979-473c-b44a-ee6766396a30 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-56d7966f-7979-473c-b44a-ee6766396a30 tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:32 devstack sudo[91823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:45:32 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:32 devstack sudo[91822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-930a9020-56de-4783-901e-2236c04df3cf Apr 29 06:45:32 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:32 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-bdb14256-be8c-46a1-9306-2780f846fc9e tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "cinder-6b02ff18-6062-4b7f-83cb-26e68233f5b3-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:32 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-bdb14256-be8c-46a1-9306-2780f846fc9e tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-6b02ff18-6062-4b7f-83cb-26e68233f5b3-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:32 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-bdb14256-be8c-46a1-9306-2780f846fc9e tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "cinder-quobyte-6b02ff18-6062-4b7f-83cb-26e68233f5b3" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:32 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-bdb14256-be8c-46a1-9306-2780f846fc9e tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-6b02ff18-6062-4b7f-83cb-26e68233f5b3" acquired by "delete_volume" :: waited 0.034s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:33 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a86d88-2063-4fc6-8274-cf44f81fadc2]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:45:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bdb14256-be8c-46a1-9306-2780f846fc9e tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:33 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4378710c-1e41-4b98-9044-f40d0dca2b0f tempest-VolumesTransfersTest-1375746525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-930a9020-56de-4783-901e-2236c04df3cf" returned: 0 in 1.092s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4378710c-1e41-4b98-9044-f40d0dca2b0f tempest-VolumesTransfersTest-1375746525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-930a9020-56de-4783-901e-2236c04df3cf {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:33 devstack sudo[91836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3 Apr 29 06:45:33 devstack sudo[91836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:33 devstack sudo[91838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-930a9020-56de-4783-901e-2236c04df3cf Apr 29 06:45:33 devstack sudo[91838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:33 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-56d7966f-7979-473c-b44a-ee6766396a30 tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 1.131s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:33 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-56d7966f-7979-473c-b44a-ee6766396a30 tempest-VolumesSnapshotTestJSON-917607631 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:45:33 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-56d7966f-7979-473c-b44a-ee6766396a30 tempest-VolumesSnapshotTestJSON-917607631 None] Deleted volume successfully. Apr 29 06:45:33 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-56d7966f-7979-473c-b44a-ee6766396a30 tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-e6f41dea-11e3-4e4c-b8bd-6873ee1680d7-delete_volume" released by "delete_volume" :: held 3.094s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:33 devstack sudo[91836]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bdb14256-be8c-46a1-9306-2780f846fc9e tempest-VolumesSnapshotTestJSON-917607631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3" returned: 0 in 0.956s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bdb14256-be8c-46a1-9306-2780f846fc9e tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:34 devstack sudo[91838]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4378710c-1e41-4b98-9044-f40d0dca2b0f tempest-VolumesTransfersTest-1375746525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-930a9020-56de-4783-901e-2236c04df3cf" returned: 0 in 0.863s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:34 devstack sudo[91845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3 Apr 29 06:45:34 devstack sudo[91845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:34 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4378710c-1e41-4b98-9044-f40d0dca2b0f tempest-VolumesTransfersTest-1375746525 None] Lock "cinder-quobyte-930a9020-56de-4783-901e-2236c04df3cf" released by "delete_volume" :: held 2.031s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:34 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-4378710c-1e41-4b98-9044-f40d0dca2b0f tempest-VolumesTransfersTest-1375746525 None] Created reservations ['ab4dd0a3-8434-4529-a1a0-55dd38a576c7', '246659d5-4c28-481b-9d09-e0d77bb7d004', 'f561a69d-e1aa-492c-9f09-cb10bb77409f', '21203fc9-f0e6-44de-851e-b8f30eac83dd'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:45:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4378710c-1e41-4b98-9044-f40d0dca2b0f tempest-VolumesTransfersTest-1375746525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4378710c-1e41-4b98-9044-f40d0dca2b0f tempest-VolumesTransfersTest-1375746525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4378710c-1e41-4b98-9044-f40d0dca2b0f tempest-VolumesTransfersTest-1375746525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:45:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4378710c-1e41-4b98-9044-f40d0dca2b0f tempest-VolumesTransfersTest-1375746525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:45:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4378710c-1e41-4b98-9044-f40d0dca2b0f tempest-VolumesTransfersTest-1375746525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4378710c-1e41-4b98-9044-f40d0dca2b0f tempest-VolumesTransfersTest-1375746525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:34 devstack sudo[91847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:45:34 devstack sudo[91847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:34 devstack sudo[91845]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bdb14256-be8c-46a1-9306-2780f846fc9e tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6b02ff18-6062-4b7f-83cb-26e68233f5b3" returned: 0 in 0.807s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:34 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-bdb14256-be8c-46a1-9306-2780f846fc9e tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-quobyte-6b02ff18-6062-4b7f-83cb-26e68233f5b3" released by "delete_volume" :: held 1.873s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:34 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-bdb14256-be8c-46a1-9306-2780f846fc9e tempest-VolumesSnapshotTestJSON-917607631 None] Created reservations ['7527e723-bd64-43a6-9a7e-16176e01cf8f', '3007a996-eecc-47b4-a28c-48d72a8669e9', '451c7746-20b1-4276-b97d-3d075ee09f2b', '765e8b9f-e7c3-447c-97f4-9a01b541d6d8'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:45:34 devstack sudo[91847]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4378710c-1e41-4b98-9044-f40d0dca2b0f tempest-VolumesTransfersTest-1375746525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.778s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:34 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-4378710c-1e41-4b98-9044-f40d0dca2b0f tempest-VolumesTransfersTest-1375746525 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:45:35 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-4378710c-1e41-4b98-9044-f40d0dca2b0f tempest-VolumesTransfersTest-1375746525 None] Deleted volume successfully. Apr 29 06:45:35 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4378710c-1e41-4b98-9044-f40d0dca2b0f tempest-VolumesTransfersTest-1375746525 None] Lock "cinder-930a9020-56de-4783-901e-2236c04df3cf-delete_volume" released by "delete_volume" :: held 3.208s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-bdb14256-be8c-46a1-9306-2780f846fc9e tempest-VolumesSnapshotTestJSON-917607631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-bdb14256-be8c-46a1-9306-2780f846fc9e tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-bdb14256-be8c-46a1-9306-2780f846fc9e tempest-VolumesSnapshotTestJSON-917607631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:45:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-bdb14256-be8c-46a1-9306-2780f846fc9e tempest-VolumesSnapshotTestJSON-917607631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:45:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-bdb14256-be8c-46a1-9306-2780f846fc9e tempest-VolumesSnapshotTestJSON-917607631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bdb14256-be8c-46a1-9306-2780f846fc9e tempest-VolumesSnapshotTestJSON-917607631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:35 devstack sudo[91853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:45:35 devstack sudo[91853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:35 devstack sudo[91853]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bdb14256-be8c-46a1-9306-2780f846fc9e tempest-VolumesSnapshotTestJSON-917607631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.705s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:35 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-bdb14256-be8c-46a1-9306-2780f846fc9e tempest-VolumesSnapshotTestJSON-917607631 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:45:35 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-bdb14256-be8c-46a1-9306-2780f846fc9e tempest-VolumesSnapshotTestJSON-917607631 None] Deleted volume successfully. Apr 29 06:45:35 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-bdb14256-be8c-46a1-9306-2780f846fc9e tempest-VolumesSnapshotTestJSON-917607631 None] Lock "cinder-6b02ff18-6062-4b7f-83cb-26e68233f5b3-delete_volume" released by "delete_volume" :: held 3.068s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Flow 'volume_create_manager' (184ff489-c6ce-47a0-a432-46772224093c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c86fba0-f094-40f8-8a70-9fa5bed57baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c86fba0-f094-40f8-8a70-9fa5bed57baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-823624117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14628d63-b2b2-47c2-b1d9-977f2f2d3094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e06efaabb1408394e64ebc23c8854b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:45:36Z,use_quota=True,user_id='3caf1da1f27a4aa48ee7615a11d58c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e5f6812-9302-4600-b3c1-f82cd140c3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e5f6812-9302-4600-b3c1-f82cd140c3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7c5c36-8a68-4d60-8e66-4d5ac7232b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7c5c36-8a68-4d60-8e66-4d5ac7232b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14628d63-b2b2-47c2-b1d9-977f2f2d3094', 'volume_name': 'volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd5b562-d3ef-431b-bebb-bbf1136c277d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd5b562-d3ef-431b-bebb-bbf1136c277d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557193de-a6a5-472e-94b9-b01cdd6f92f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:36 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Volume 14628d63-b2b2-47c2-b1d9-977f2f2d3094: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094', 'volume_size': 1} Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-823624117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14628d63-b2b2-47c2-b1d9-977f2f2d3094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e06efaabb1408394e64ebc23c8854b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:45:36Z,use_quota=True,user_id='3caf1da1f27a4aa48ee7615a11d58c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Creating volume 14628d63-b2b2-47c2-b1d9-977f2f2d3094 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:45:36 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:36 devstack sudo[91856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094 1073741824 Apr 29 06:45:36 devstack sudo[91856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG oslo_service.periodic_task [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84195) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:36 devstack sudo[91859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:45:36 devstack sudo[91859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:37 devstack sudo[91856]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094 1073741824" returned: 0 in 1.016s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:37 devstack sudo[91859]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.845s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:37 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:45:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:37 devstack sudo[91867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094 Apr 29 06:45:37 devstack sudo[91867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:38 devstack sudo[91867]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094" returned: 0 in 0.678s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:38 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:45:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:38 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557193de-a6a5-472e-94b9-b01cdd6f92f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:38 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a2a2b39-d592-4520-b529-ac55acb2cefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:38 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Volume volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094 (14628d63-b2b2-47c2-b1d9-977f2f2d3094): created successfully Apr 29 06:45:38 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a2a2b39-d592-4520-b529-ac55acb2cefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:38 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Flow 'volume_create_manager' (184ff489-c6ce-47a0-a432-46772224093c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:45:38 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-844f24fc-bf30-4d9f-8131-e81b3a99b778 tempest-SnapshotDependencyTests-1779789944 None] Created volume successfully. Apr 29 06:45:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9396ac70-0ac9-470d-bf9e-2ddf24defc3b tempest-SnapshotDependencyTests-1779789944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9396ac70-0ac9-470d-bf9e-2ddf24defc3b tempest-SnapshotDependencyTests-1779789944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:38 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-9396ac70-0ac9-470d-bf9e-2ddf24defc3b tempest-SnapshotDependencyTests-1779789944 None] Creating offline snapshot f3864bc1-234c-43f5-b3d7-dc91004fee24 of volume 14628d63-b2b2-47c2-b1d9-977f2f2d3094 {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:45:38 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[61444b12-97ea-413c-b98d-59dfdd0b1efe]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:45:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9396ac70-0ac9-470d-bf9e-2ddf24defc3b tempest-SnapshotDependencyTests-1779789944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:38 devstack sudo[91870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094 Apr 29 06:45:38 devstack sudo[91870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:39 devstack sudo[91870]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9396ac70-0ac9-470d-bf9e-2ddf24defc3b tempest-SnapshotDependencyTests-1779789944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094" returned: 0 in 0.791s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9396ac70-0ac9-470d-bf9e-2ddf24defc3b tempest-SnapshotDependencyTests-1779789944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.f3864bc1-234c-43f5-b3d7-dc91004fee24 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:39 devstack sudo[91877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.f3864bc1-234c-43f5-b3d7-dc91004fee24 1G Apr 29 06:45:39 devstack sudo[91877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:40 devstack sudo[91877]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9396ac70-0ac9-470d-bf9e-2ddf24defc3b tempest-SnapshotDependencyTests-1779789944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.f3864bc1-234c-43f5-b3d7-dc91004fee24 1G" returned: 0 in 0.942s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9396ac70-0ac9-470d-bf9e-2ddf24defc3b tempest-SnapshotDependencyTests-1779789944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.f3864bc1-234c-43f5-b3d7-dc91004fee24 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:40 devstack sudo[91883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.f3864bc1-234c-43f5-b3d7-dc91004fee24 Apr 29 06:45:40 devstack sudo[91883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:41 devstack sudo[91883]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9396ac70-0ac9-470d-bf9e-2ddf24defc3b tempest-SnapshotDependencyTests-1779789944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.f3864bc1-234c-43f5-b3d7-dc91004fee24" returned: 0 in 0.683s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:41 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-9396ac70-0ac9-470d-bf9e-2ddf24defc3b tempest-SnapshotDependencyTests-1779789944 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.f3864bc1-234c-43f5-b3d7-dc91004fee24 is being set with open permissions: ugo+rw Apr 29 06:45:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9396ac70-0ac9-470d-bf9e-2ddf24defc3b tempest-SnapshotDependencyTests-1779789944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.f3864bc1-234c-43f5-b3d7-dc91004fee24 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:41 devstack sudo[91888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.f3864bc1-234c-43f5-b3d7-dc91004fee24 Apr 29 06:45:41 devstack sudo[91888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:41 devstack sudo[91888]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9396ac70-0ac9-470d-bf9e-2ddf24defc3b tempest-SnapshotDependencyTests-1779789944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.f3864bc1-234c-43f5-b3d7-dc91004fee24" returned: 0 in 0.730s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9396ac70-0ac9-470d-bf9e-2ddf24defc3b tempest-SnapshotDependencyTests-1779789944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:42 devstack sudo[91891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.info Apr 29 06:45:42 devstack sudo[91891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:42 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:45:42 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Flow 'volume_create_manager' (dc80d517-217c-4d2c-b55d-26eaf778b286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:45:42 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cbc7af1-b2e5-48d6-953b-0375997c7e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:42 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cbc7af1-b2e5-48d6-953b-0375997c7e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-881381047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d1c373c-27bc-47a4-bbc2-cd742de7cf3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3789dc9e04b404a80954ec632e343b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:45:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:45:43Z,use_quota=True,user_id='f53ed30a51db4a29962527f018950fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:42 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47624ca5-db52-4018-aee2-0152d96879e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:42 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47624ca5-db52-4018-aee2-0152d96879e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:42 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f2d80a-e0a7-4a28-8f78-1f2bcd7f5aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:42 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f2d80a-e0a7-4a28-8f78-1f2bcd7f5aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d1c373c-27bc-47a4-bbc2-cd742de7cf3f', 'volume_name': 'volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f', 'volume_size': 2}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:42 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cddcacd-a073-4457-98d4-08dc8a927d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:42 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cddcacd-a073-4457-98d4-08dc8a927d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:42 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53bcb35c-437d-43d7-a119-7abf59f57de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:42 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Volume 8d1c373c-27bc-47a4-bbc2-cd742de7cf3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f', 'volume_size': 2} Apr 29 06:45:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:42 devstack sudo[91891]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9396ac70-0ac9-470d-bf9e-2ddf24defc3b tempest-SnapshotDependencyTests-1779789944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.info" returned: 0 in 0.651s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:42 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-9396ac70-0ac9-470d-bf9e-2ddf24defc3b tempest-SnapshotDependencyTests-1779789944 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.info is being set with open permissions: ugo+rw Apr 29 06:45:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9396ac70-0ac9-470d-bf9e-2ddf24defc3b tempest-SnapshotDependencyTests-1779789944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:42 devstack sudo[91894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.info Apr 29 06:45:42 devstack sudo[91894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:43 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:45:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Flow 'volume_create_manager' (2b402495-3679-4ab8-96c6-80d33d9d3b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:45:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe71c175-33de-43bf-9668-e27d7c082e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:43 devstack sudo[91894]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe71c175-33de-43bf-9668-e27d7c082e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-725332771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=616b8376-49b2-467a-ae65-ef32bc37e1e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6facb87d060b4870b6af30ddc177fa41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:45:43Z,use_quota=True,user_id='5d745416c47b4798968cb9d9ae425bd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2430d03-38e5-43a3-84ee-8befb3477178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2430d03-38e5-43a3-84ee-8befb3477178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0867e8c-77b2-46ed-94bb-b6213f440c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0867e8c-77b2-46ed-94bb-b6213f440c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '616b8376-49b2-467a-ae65-ef32bc37e1e3', 'volume_name': 'volume-616b8376-49b2-467a-ae65-ef32bc37e1e3', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32eb39ca-ee05-43a7-b5ab-1c5d4ed7f77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32eb39ca-ee05-43a7-b5ab-1c5d4ed7f77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adae0432-cfe8-4b6a-aa81-8d096d06d6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:43 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Volume 616b8376-49b2-467a-ae65-ef32bc37e1e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-616b8376-49b2-467a-ae65-ef32bc37e1e3', 'volume_size': 1} Apr 29 06:45:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9396ac70-0ac9-470d-bf9e-2ddf24defc3b tempest-SnapshotDependencyTests-1779789944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.info" returned: 0 in 0.642s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9396ac70-0ac9-470d-bf9e-2ddf24defc3b tempest-SnapshotDependencyTests-1779789944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.553s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.665s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:43 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-881381047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d1c373c-27bc-47a4-bbc2-cd742de7cf3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3789dc9e04b404a80954ec632e343b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:45:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:45:43Z,use_quota=True,user_id='f53ed30a51db4a29962527f018950fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:45:43 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Creating volume 8d1c373c-27bc-47a4-bbc2-cd742de7cf3f {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:45:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:43 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:45:43 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:45:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:43 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:45:43 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:45:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f 2147483648 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:43 devstack sudo[91897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f 2147483648 Apr 29 06:45:43 devstack sudo[91897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:43 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-9396ac70-0ac9-470d-bf9e-2ddf24defc3b tempest-SnapshotDependencyTests-1779789944 None] Create snapshot completed successfully Apr 29 06:45:44 devstack sudo[91897]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f 2147483648" returned: 0 in 0.836s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:44 devstack sudo[91903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f Apr 29 06:45:44 devstack sudo[91903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Flow 'volume_create_manager' (3a70e2cc-012e-4414-8ffb-9a5e8580b626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2f19a8a-ad71-439c-90be-bff375a81f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2f19a8a-ad71-439c-90be-bff375a81f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045d7513-9059-45ee-afdd-b600bfe331f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e06efaabb1408394e64ebc23c8854b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f3864bc1-234c-43f5-b3d7-dc91004fee24,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:45:44Z,use_quota=True,user_id='3caf1da1f27a4aa48ee7615a11d58c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f35f2a2-8da3-4608-b946-6a1b3dbc3ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f35f2a2-8da3-4608-b946-6a1b3dbc3ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (554dbfe1-3e28-4200-aa0d-7444cb0dea56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (554dbfe1-3e28-4200-aa0d-7444cb0dea56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '045d7513-9059-45ee-afdd-b600bfe331f4', 'volume_name': 'volume-045d7513-9059-45ee-afdd-b600bfe331f4', 'volume_size': 1, 'snapshot_id': 'f3864bc1-234c-43f5-b3d7-dc91004fee24'}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2223f0ae-0c8a-40cb-b5e2-3fdae3c562ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2223f0ae-0c8a-40cb-b5e2-3fdae3c562ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c20cc7c-2ef0-4f11-9f16-27feb34d3e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:44 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Volume 045d7513-9059-45ee-afdd-b600bfe331f4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-045d7513-9059-45ee-afdd-b600bfe331f4', 'volume_size': 1, 'snapshot_id': 'f3864bc1-234c-43f5-b3d7-dc91004fee24'} Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:44 devstack sudo[91903]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f" returned: 0 in 0.589s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.494s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-725332771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=616b8376-49b2-467a-ae65-ef32bc37e1e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6facb87d060b4870b6af30ddc177fa41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:45:43Z,use_quota=True,user_id='5d745416c47b4798968cb9d9ae425bd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Creating volume 616b8376-49b2-467a-ae65-ef32bc37e1e3 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:45:44 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-616b8376-49b2-467a-ae65-ef32bc37e1e3 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53bcb35c-437d-43d7-a119-7abf59f57de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f', 'volume_size': 2}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:44 devstack sudo[91906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-616b8376-49b2-467a-ae65-ef32bc37e1e3 1073741824 Apr 29 06:45:44 devstack sudo[91906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6e3d9f4-f559-4c04-904d-5381c242ebb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:44 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Volume volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f (8d1c373c-27bc-47a4-bbc2-cd742de7cf3f): created successfully Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6e3d9f4-f559-4c04-904d-5381c242ebb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:44 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Flow 'volume_create_manager' (dc80d517-217c-4d2c-b55d-26eaf778b286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:45:44 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-efcceb78-30a1-41b7-aeb0-95e00c72ecca tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Created volume successfully. Apr 29 06:45:45 devstack sudo[91906]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-616b8376-49b2-467a-ae65-ef32bc37e1e3 1073741824" returned: 0 in 0.775s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-616b8376-49b2-467a-ae65-ef32bc37e1e3 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:45 devstack sudo[91911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-616b8376-49b2-467a-ae65-ef32bc37e1e3 Apr 29 06:45:45 devstack sudo[91911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5feb16a7-59ce-4c39-ae0e-70ac89481585 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:46 devstack sudo[91911]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-616b8376-49b2-467a-ae65-ef32bc37e1e3" returned: 0 in 0.601s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:45:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.609s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Acquiring lock "cinder-quobyte-f3864bc1-234c-43f5-b3d7-dc91004fee24-045d7513-9059-45ee-afdd-b600bfe331f4" by "_create_volume_from_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adae0432-cfe8-4b6a-aa81-8d096d06d6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-616b8376-49b2-467a-ae65-ef32bc37e1e3', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7e11402-7b36-4085-a3dc-5b07c9d6e78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Lock "cinder-quobyte-f3864bc1-234c-43f5-b3d7-dc91004fee24-045d7513-9059-45ee-afdd-b600bfe331f4" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Creating volume 045d7513-9059-45ee-afdd-b600bfe331f4 from snapshot f3864bc1-234c-43f5-b3d7-dc91004fee24 {{(pid=84195) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 06:45:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:45:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:45:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:45:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Acquiring lock "cinder-quobyte-045d7513-9059-45ee-afdd-b600bfe331f4" by "_copy_volume_from_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:46 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Volume volume-616b8376-49b2-467a-ae65-ef32bc37e1e3 (616b8376-49b2-467a-ae65-ef32bc37e1e3): created successfully Apr 29 06:45:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7e11402-7b36-4085-a3dc-5b07c9d6e78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:46 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Flow 'volume_create_manager' (2b402495-3679-4ab8-96c6-80d33d9d3b96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:45:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Lock "cinder-quobyte-045d7513-9059-45ee-afdd-b600bfe331f4" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] snapshot: f3864bc1-234c-43f5-b3d7-dc91004fee24, volume: 045d7513-9059-45ee-afdd-b600bfe331f4, {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 06:45:46 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-7a1b215c-3519-4cbb-99e5-58f92badcd98 tempest-VolumesTransfersV357Test-714843873 None] Created volume successfully. Apr 29 06:45:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:45:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:45:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:46 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa26f7b8-78c3-42e7-bdba-7486ce3e1ce7]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:45:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.f3864bc1-234c-43f5-b3d7-dc91004fee24 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:46 devstack sudo[91914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.f3864bc1-234c-43f5-b3d7-dc91004fee24 Apr 29 06:45:46 devstack sudo[91914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:46 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-2ffb4a99-8308-496f-8e08-b4d01d0c7b73 tempest-VolumesTransfersV357Test-975073754 None] Transfer volume completed successfully. Apr 29 06:45:47 devstack sudo[91914]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.f3864bc1-234c-43f5-b3d7-dc91004fee24" returned: 0 in 0.733s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:45:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094 {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 06:45:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Creating direct copy from snapshot {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 06:45:47 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd53136-f108-4386-825b-04f92fa8e954]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:45:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:47 devstack sudo[91921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094 Apr 29 06:45:47 devstack sudo[91921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:47 devstack sudo[91921]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094" returned: 0 in 0.730s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:47 devstack cinder-volume[84195]: DEBUG cinder.utils [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Path /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-045d7513-9059-45ee-afdd-b600bfe331f4 not found in is_blk_device check {{(pid=84195) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 06:45:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-045d7513-9059-45ee-afdd-b600bfe331f4 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:47 devstack sudo[91926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-045d7513-9059-45ee-afdd-b600bfe331f4 Apr 29 06:45:47 devstack sudo[91926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-670c7743-bc85-465a-9b30-57ce2ef6d8b1 tempest-VolumesTransfersV357Test-2102232431 None] Acquiring lock "cinder-616b8376-49b2-467a-ae65-ef32bc37e1e3-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-670c7743-bc85-465a-9b30-57ce2ef6d8b1 tempest-VolumesTransfersV357Test-2102232431 None] Lock "cinder-616b8376-49b2-467a-ae65-ef32bc37e1e3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-670c7743-bc85-465a-9b30-57ce2ef6d8b1 tempest-VolumesTransfersV357Test-2102232431 None] Acquiring lock "cinder-quobyte-616b8376-49b2-467a-ae65-ef32bc37e1e3" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-670c7743-bc85-465a-9b30-57ce2ef6d8b1 tempest-VolumesTransfersV357Test-2102232431 None] Lock "cinder-quobyte-616b8376-49b2-467a-ae65-ef32bc37e1e3" acquired by "delete_volume" :: waited 0.023s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:48 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[7746789b-a16f-4e23-9664-f1fab6de03f3]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:45:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-670c7743-bc85-465a-9b30-57ce2ef6d8b1 tempest-VolumesTransfersV357Test-2102232431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-616b8376-49b2-467a-ae65-ef32bc37e1e3 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:48 devstack sudo[91928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-616b8376-49b2-467a-ae65-ef32bc37e1e3 Apr 29 06:45:48 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:49 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-670c7743-bc85-465a-9b30-57ce2ef6d8b1 tempest-VolumesTransfersV357Test-2102232431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-616b8376-49b2-467a-ae65-ef32bc37e1e3" returned: 0 in 1.262s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-670c7743-bc85-465a-9b30-57ce2ef6d8b1 tempest-VolumesTransfersV357Test-2102232431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-616b8376-49b2-467a-ae65-ef32bc37e1e3 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:49 devstack sudo[91943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-616b8376-49b2-467a-ae65-ef32bc37e1e3 Apr 29 06:45:49 devstack sudo[91943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:50 devstack sudo[91943]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-670c7743-bc85-465a-9b30-57ce2ef6d8b1 tempest-VolumesTransfersV357Test-2102232431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-616b8376-49b2-467a-ae65-ef32bc37e1e3" returned: 0 in 1.121s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:50 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-670c7743-bc85-465a-9b30-57ce2ef6d8b1 tempest-VolumesTransfersV357Test-2102232431 None] Lock "cinder-quobyte-616b8376-49b2-467a-ae65-ef32bc37e1e3" released by "delete_volume" :: held 2.458s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:50 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-670c7743-bc85-465a-9b30-57ce2ef6d8b1 tempest-VolumesTransfersV357Test-2102232431 None] Created reservations ['f3a87c11-3d68-409d-bac9-6a15405bdf30', '48a979e6-56ae-4303-bd35-aa8236c15086', '0764ffc2-8725-4b79-916b-529656ccbed3', 'fcdca611-a2c4-4e99-85ae-aebca8d8b67e'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:45:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-670c7743-bc85-465a-9b30-57ce2ef6d8b1 tempest-VolumesTransfersV357Test-2102232431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-670c7743-bc85-465a-9b30-57ce2ef6d8b1 tempest-VolumesTransfersV357Test-2102232431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:50 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-670c7743-bc85-465a-9b30-57ce2ef6d8b1 tempest-VolumesTransfersV357Test-2102232431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:45:50 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-670c7743-bc85-465a-9b30-57ce2ef6d8b1 tempest-VolumesTransfersV357Test-2102232431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:45:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-670c7743-bc85-465a-9b30-57ce2ef6d8b1 tempest-VolumesTransfersV357Test-2102232431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-670c7743-bc85-465a-9b30-57ce2ef6d8b1 tempest-VolumesTransfersV357Test-2102232431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:50 devstack sudo[91946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:45:50 devstack sudo[91946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:51 devstack sudo[91946]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-670c7743-bc85-465a-9b30-57ce2ef6d8b1 tempest-VolumesTransfersV357Test-2102232431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 1.229s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:51 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-670c7743-bc85-465a-9b30-57ce2ef6d8b1 tempest-VolumesTransfersV357Test-2102232431 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:45:51 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-670c7743-bc85-465a-9b30-57ce2ef6d8b1 tempest-VolumesTransfersV357Test-2102232431 None] Deleted volume successfully. Apr 29 06:45:52 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-670c7743-bc85-465a-9b30-57ce2ef6d8b1 tempest-VolumesTransfersV357Test-2102232431 None] Lock "cinder-616b8376-49b2-467a-ae65-ef32bc37e1e3-delete_volume" released by "delete_volume" :: held 4.144s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:52 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:45:52 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Flow 'volume_create_manager' (32aee4fc-1d8a-485f-9929-2019ef2d8f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:45:52 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148f6df6-7c7e-42a2-bb41-e3486044de39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:52 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148f6df6-7c7e-42a2-bb41-e3486044de39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-350897256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4511425b-fb70-4c66-84a4-8c044b88bf4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6facb87d060b4870b6af30ddc177fa41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:45:52Z,use_quota=True,user_id='5d745416c47b4798968cb9d9ae425bd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:52 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c971ac-ca5f-439e-86b9-626f7fdfbf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:52 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c971ac-ca5f-439e-86b9-626f7fdfbf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:52 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8aa09e8-a937-4e25-a98d-a0877032d679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:52 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8aa09e8-a937-4e25-a98d-a0877032d679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4511425b-fb70-4c66-84a4-8c044b88bf4f', 'volume_name': 'volume-4511425b-fb70-4c66-84a4-8c044b88bf4f', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:52 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57abdd3e-1b77-4ab6-be98-34455e0c14c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:52 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57abdd3e-1b77-4ab6-be98-34455e0c14c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:52 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d21870c6-578b-4bcd-a9ce-3682e547132b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:52 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Volume 4511425b-fb70-4c66-84a4-8c044b88bf4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4511425b-fb70-4c66-84a4-8c044b88bf4f', 'volume_size': 1} Apr 29 06:45:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:52 devstack sudo[91926]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-045d7513-9059-45ee-afdd-b600bfe331f4" returned: 0 in 5.073s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:52 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bed0c9-b4e2-4254-8ac3-1984a734e21b]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:45:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:53 devstack sudo[91950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094 Apr 29 06:45:53 devstack sudo[91950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:53 devstack sudo[91950]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094" returned: 0 in 0.851s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:53 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Image conversion details: src /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094, size 1024.00 MB, duration 5.07 sec, destination /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-045d7513-9059-45ee-afdd-b600bfe331f4 {{(pid=84195) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 06:45:53 devstack cinder-volume[84195]: INFO cinder.image.image_utils [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Converted 1024.00 MB image at 201.80 MB/s Apr 29 06:45:53 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-045d7513-9059-45ee-afdd-b600bfe331f4 is being set with open permissions: ugo+rw Apr 29 06:45:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-045d7513-9059-45ee-afdd-b600bfe331f4 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:53 devstack sudo[91955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-045d7513-9059-45ee-afdd-b600bfe331f4 Apr 29 06:45:53 devstack sudo[91955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:54 devstack sudo[91955]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-045d7513-9059-45ee-afdd-b600bfe331f4" returned: 0 in 0.584s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:54 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Lock "cinder-quobyte-045d7513-9059-45ee-afdd-b600bfe331f4" released by "_copy_volume_from_snapshot" :: held 8.073s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:54 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Lock "cinder-quobyte-f3864bc1-234c-43f5-b3d7-dc91004fee24-045d7513-9059-45ee-afdd-b600bfe331f4" released by "_create_volume_from_snapshot" :: held 8.114s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.151s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5feb16a7-59ce-4c39-ae0e-70ac89481585 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.443s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:54 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-5feb16a7-59ce-4c39-ae0e-70ac89481585 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Creating offline snapshot 78b51c71-3e28-481c-a499-2ad4359250d0 of volume 8d1c373c-27bc-47a4-bbc2-cd742de7cf3f {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:45:54 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[17358233-f490-4eea-9c55-f68a61acb9ec]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:45:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5feb16a7-59ce-4c39-ae0e-70ac89481585 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:54 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c20cc7c-2ef0-4f11-9f16-27feb34d3e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-045d7513-9059-45ee-afdd-b600bfe331f4', 'volume_size': 1, 'snapshot_id': 'f3864bc1-234c-43f5-b3d7-dc91004fee24'}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:54 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e43f02a-65f8-4c75-b09a-6d5261a66d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:45:54 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Volume volume-045d7513-9059-45ee-afdd-b600bfe331f4 (045d7513-9059-45ee-afdd-b600bfe331f4): created successfully Apr 29 06:45:54 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e43f02a-65f8-4c75-b09a-6d5261a66d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:45:54 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Flow 'volume_create_manager' (3a70e2cc-012e-4414-8ffb-9a5e8580b626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:45:54 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-8837fb09-212d-4b5e-93de-0304ba8cfe95 tempest-SnapshotDependencyTests-1779789944 None] Created volume successfully. Apr 29 06:45:54 devstack sudo[91958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f Apr 29 06:45:54 devstack sudo[91958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:55 devstack sudo[91958]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5feb16a7-59ce-4c39-ae0e-70ac89481585 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f" returned: 0 in 0.691s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5feb16a7-59ce-4c39-ae0e-70ac89481585 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f.78b51c71-3e28-481c-a499-2ad4359250d0 2G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:55 devstack sudo[91963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f.78b51c71-3e28-481c-a499-2ad4359250d0 2G Apr 29 06:45:55 devstack sudo[91963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2677b9b3-4866-4701-8224-c1c3f24d30a2 tempest-SnapshotDependencyTests-1779789944 None] Acquiring lock "cinder-f3864bc1-234c-43f5-b3d7-dc91004fee24-delete_snapshot" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2677b9b3-4866-4701-8224-c1c3f24d30a2 tempest-SnapshotDependencyTests-1779789944 None] Lock "cinder-f3864bc1-234c-43f5-b3d7-dc91004fee24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2677b9b3-4866-4701-8224-c1c3f24d30a2 tempest-SnapshotDependencyTests-1779789944 None] Acquiring lock "cinder-quobyte-14628d63-b2b2-47c2-b1d9-977f2f2d3094" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2677b9b3-4866-4701-8224-c1c3f24d30a2 tempest-SnapshotDependencyTests-1779789944 None] Lock "cinder-quobyte-14628d63-b2b2-47c2-b1d9-977f2f2d3094" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2677b9b3-4866-4701-8224-c1c3f24d30a2 tempest-SnapshotDependencyTests-1779789944 None] Acquiring lock "cinder-quobyte-f3864bc1-234c-43f5-b3d7-dc91004fee24" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2677b9b3-4866-4701-8224-c1c3f24d30a2 tempest-SnapshotDependencyTests-1779789944 None] Lock "cinder-quobyte-f3864bc1-234c-43f5-b3d7-dc91004fee24" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:55 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-2677b9b3-4866-4701-8224-c1c3f24d30a2 tempest-SnapshotDependencyTests-1779789944 None] Deleting offline snapshot f3864bc1-234c-43f5-b3d7-dc91004fee24 of volume 14628d63-b2b2-47c2-b1d9-977f2f2d3094 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:45:55 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-2677b9b3-4866-4701-8224-c1c3f24d30a2 tempest-SnapshotDependencyTests-1779789944 None] snapshot_file for this snap is: volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.f3864bc1-234c-43f5-b3d7-dc91004fee24 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:45:55 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63d465c-b4c5-4bbe-8efb-bd3183f9f121]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:45:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2677b9b3-4866-4701-8224-c1c3f24d30a2 tempest-SnapshotDependencyTests-1779789944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.f3864bc1-234c-43f5-b3d7-dc91004fee24 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:55 devstack sudo[91966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.f3864bc1-234c-43f5-b3d7-dc91004fee24 Apr 29 06:45:55 devstack sudo[91966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:55 devstack sudo[91963]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5feb16a7-59ce-4c39-ae0e-70ac89481585 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f.78b51c71-3e28-481c-a499-2ad4359250d0 2G" returned: 0 in 0.746s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5feb16a7-59ce-4c39-ae0e-70ac89481585 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f.78b51c71-3e28-481c-a499-2ad4359250d0 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:55 devstack sudo[91970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f.78b51c71-3e28-481c-a499-2ad4359250d0 Apr 29 06:45:55 devstack sudo[91970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:56 devstack sudo[91966]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2677b9b3-4866-4701-8224-c1c3f24d30a2 tempest-SnapshotDependencyTests-1779789944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.f3864bc1-234c-43f5-b3d7-dc91004fee24" returned: 0 in 0.716s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-2677b9b3-4866-4701-8224-c1c3f24d30a2 tempest-SnapshotDependencyTests-1779789944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:45:56 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f6eace-bcf9-43bc-ba05-85ac0aeadbcf]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:45:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2677b9b3-4866-4701-8224-c1c3f24d30a2 tempest-SnapshotDependencyTests-1779789944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:56 devstack sudo[91976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094 Apr 29 06:45:56 devstack sudo[91976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:56 devstack sudo[91970]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5feb16a7-59ce-4c39-ae0e-70ac89481585 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f.78b51c71-3e28-481c-a499-2ad4359250d0" returned: 0 in 0.628s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:56 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-5feb16a7-59ce-4c39-ae0e-70ac89481585 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f.78b51c71-3e28-481c-a499-2ad4359250d0 is being set with open permissions: ugo+rw Apr 29 06:45:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5feb16a7-59ce-4c39-ae0e-70ac89481585 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f.78b51c71-3e28-481c-a499-2ad4359250d0 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:56 devstack sudo[91981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f.78b51c71-3e28-481c-a499-2ad4359250d0 Apr 29 06:45:56 devstack sudo[91981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:57 devstack sudo[91981]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5feb16a7-59ce-4c39-ae0e-70ac89481585 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f.78b51c71-3e28-481c-a499-2ad4359250d0" returned: 0 in 0.600s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:57 devstack sudo[91976]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2677b9b3-4866-4701-8224-c1c3f24d30a2 tempest-SnapshotDependencyTests-1779789944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094" returned: 0 in 0.764s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2677b9b3-4866-4701-8224-c1c3f24d30a2 tempest-SnapshotDependencyTests-1779789944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.f3864bc1-234c-43f5-b3d7-dc91004fee24 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:57 devstack sudo[91987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.f3864bc1-234c-43f5-b3d7-dc91004fee24 Apr 29 06:45:57 devstack sudo[91987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5feb16a7-59ce-4c39-ae0e-70ac89481585 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:57 devstack sudo[91989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f.info Apr 29 06:45:57 devstack sudo[91989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:57 devstack sudo[91989]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5feb16a7-59ce-4c39-ae0e-70ac89481585 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f.info" returned: 0 in 0.616s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:57 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-5feb16a7-59ce-4c39-ae0e-70ac89481585 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f.info is being set with open permissions: ugo+rw Apr 29 06:45:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5feb16a7-59ce-4c39-ae0e-70ac89481585 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:57 devstack sudo[91995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f.info Apr 29 06:45:57 devstack sudo[91995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:57 devstack sudo[91987]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2677b9b3-4866-4701-8224-c1c3f24d30a2 tempest-SnapshotDependencyTests-1779789944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.f3864bc1-234c-43f5-b3d7-dc91004fee24" returned: 0 in 0.698s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2677b9b3-4866-4701-8224-c1c3f24d30a2 tempest-SnapshotDependencyTests-1779789944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.f3864bc1-234c-43f5-b3d7-dc91004fee24 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:57 devstack sudo[91997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.f3864bc1-234c-43f5-b3d7-dc91004fee24 Apr 29 06:45:57 devstack sudo[91997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:58 devstack sudo[91995]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5feb16a7-59ce-4c39-ae0e-70ac89481585 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f.info" returned: 0 in 0.614s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5feb16a7-59ce-4c39-ae0e-70ac89481585 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.012s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.727s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-350897256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4511425b-fb70-4c66-84a4-8c044b88bf4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6facb87d060b4870b6af30ddc177fa41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:45:52Z,use_quota=True,user_id='5d745416c47b4798968cb9d9ae425bd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Creating volume 4511425b-fb70-4c66-84a4-8c044b88bf4f {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:45:58 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-4511425b-fb70-4c66-84a4-8c044b88bf4f 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:58 devstack sudo[91997]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:58 devstack sudo[92001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-4511425b-fb70-4c66-84a4-8c044b88bf4f 1073741824 Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2677b9b3-4866-4701-8224-c1c3f24d30a2 tempest-SnapshotDependencyTests-1779789944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094.f3864bc1-234c-43f5-b3d7-dc91004fee24" returned: 0 in 0.620s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:58 devstack sudo[92001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:58 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-5feb16a7-59ce-4c39-ae0e-70ac89481585 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Create snapshot completed successfully Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2677b9b3-4866-4701-8224-c1c3f24d30a2 tempest-SnapshotDependencyTests-1779789944 None] Lock "cinder-quobyte-f3864bc1-234c-43f5-b3d7-dc91004fee24" released by "_delete_snapshot" :: held 2.903s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2677b9b3-4866-4701-8224-c1c3f24d30a2 tempest-SnapshotDependencyTests-1779789944 None] Lock "cinder-quobyte-14628d63-b2b2-47c2-b1d9-977f2f2d3094" released by "delete_snapshot" :: held 2.930s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-2677b9b3-4866-4701-8224-c1c3f24d30a2 tempest-SnapshotDependencyTests-1779789944 None] Created reservations ['4d27abf8-fda1-4f4d-8826-86158cea2932', 'a6e79d56-21d0-4c58-9fdb-1bbd1aa6a994', 'ff98664d-35ea-4580-9408-2f442f2be64d', 'bf16a1a3-18cf-47f5-b966-96a921a197d7'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:45:58 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-2677b9b3-4866-4701-8224-c1c3f24d30a2 tempest-SnapshotDependencyTests-1779789944 None] Delete snapshot completed successfully. Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2677b9b3-4866-4701-8224-c1c3f24d30a2 tempest-SnapshotDependencyTests-1779789944 None] Lock "cinder-f3864bc1-234c-43f5-b3d7-dc91004fee24-delete_snapshot" released by "delete_snapshot" :: held 3.085s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2fd1f16f-faf8-4d79-b701-77667c0ee845 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Acquiring lock "cinder-78b51c71-3e28-481c-a499-2ad4359250d0-delete_snapshot" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2fd1f16f-faf8-4d79-b701-77667c0ee845 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Lock "cinder-78b51c71-3e28-481c-a499-2ad4359250d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2fd1f16f-faf8-4d79-b701-77667c0ee845 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Acquiring lock "cinder-quobyte-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2fd1f16f-faf8-4d79-b701-77667c0ee845 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Lock "cinder-quobyte-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2fd1f16f-faf8-4d79-b701-77667c0ee845 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Acquiring lock "cinder-quobyte-78b51c71-3e28-481c-a499-2ad4359250d0" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2fd1f16f-faf8-4d79-b701-77667c0ee845 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Lock "cinder-quobyte-78b51c71-3e28-481c-a499-2ad4359250d0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-2fd1f16f-faf8-4d79-b701-77667c0ee845 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Deleting offline snapshot 78b51c71-3e28-481c-a499-2ad4359250d0 of volume 8d1c373c-27bc-47a4-bbc2-cd742de7cf3f {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-2fd1f16f-faf8-4d79-b701-77667c0ee845 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] snapshot_file for this snap is: volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f.78b51c71-3e28-481c-a499-2ad4359250d0 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-eab68658-324e-460a-8687-8142b47b2460 tempest-SnapshotDependencyTests-1779789944 None] Acquiring lock "cinder-14628d63-b2b2-47c2-b1d9-977f2f2d3094-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[75874491-dce6-4f61-a35e-70f81232d96d]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2fd1f16f-faf8-4d79-b701-77667c0ee845 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f.78b51c71-3e28-481c-a499-2ad4359250d0 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-eab68658-324e-460a-8687-8142b47b2460 tempest-SnapshotDependencyTests-1779789944 None] Lock "cinder-14628d63-b2b2-47c2-b1d9-977f2f2d3094-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-eab68658-324e-460a-8687-8142b47b2460 tempest-SnapshotDependencyTests-1779789944 None] Acquiring lock "cinder-quobyte-14628d63-b2b2-47c2-b1d9-977f2f2d3094" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-eab68658-324e-460a-8687-8142b47b2460 tempest-SnapshotDependencyTests-1779789944 None] Lock "cinder-quobyte-14628d63-b2b2-47c2-b1d9-977f2f2d3094" acquired by "delete_volume" :: waited 0.017s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dda249-92bf-4b5b-b8bb-fa296d6ba4bf]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:45:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-eab68658-324e-460a-8687-8142b47b2460 tempest-SnapshotDependencyTests-1779789944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:59 devstack sudo[92003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f.78b51c71-3e28-481c-a499-2ad4359250d0 Apr 29 06:45:59 devstack sudo[92003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:59 devstack sudo[92004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094 Apr 29 06:45:59 devstack sudo[92004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:59 devstack sudo[92001]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-4511425b-fb70-4c66-84a4-8c044b88bf4f 1073741824" returned: 0 in 0.936s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-4511425b-fb70-4c66-84a4-8c044b88bf4f {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:59 devstack sudo[92011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-4511425b-fb70-4c66-84a4-8c044b88bf4f Apr 29 06:45:59 devstack sudo[92011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:59 devstack sudo[92003]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2fd1f16f-faf8-4d79-b701-77667c0ee845 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f.78b51c71-3e28-481c-a499-2ad4359250d0" returned: 0 in 0.821s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:59 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-2fd1f16f-faf8-4d79-b701-77667c0ee845 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:45:59 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51b4907-6df4-4d20-b525-88fad9839dfa]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:45:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2fd1f16f-faf8-4d79-b701-77667c0ee845 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:59 devstack sudo[92004]: pam_unix(sudo:session): session closed for user root Apr 29 06:45:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-eab68658-324e-460a-8687-8142b47b2460 tempest-SnapshotDependencyTests-1779789944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094" returned: 0 in 0.804s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:45:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-eab68658-324e-460a-8687-8142b47b2460 tempest-SnapshotDependencyTests-1779789944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:45:59 devstack sudo[92020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094 Apr 29 06:45:59 devstack sudo[92020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:45:59 devstack sudo[92019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f Apr 29 06:45:59 devstack sudo[92019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:00 devstack sudo[92011]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-4511425b-fb70-4c66-84a4-8c044b88bf4f" returned: 0 in 0.669s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:00 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:46:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:00 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d21870c6-578b-4bcd-a9ce-3682e547132b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4511425b-fb70-4c66-84a4-8c044b88bf4f', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:00 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb3247c-364f-4daf-956d-dca7814e6344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:00 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Volume volume-4511425b-fb70-4c66-84a4-8c044b88bf4f (4511425b-fb70-4c66-84a4-8c044b88bf4f): created successfully Apr 29 06:46:00 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb3247c-364f-4daf-956d-dca7814e6344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:00 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Flow 'volume_create_manager' (32aee4fc-1d8a-485f-9929-2019ef2d8f12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:46:00 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-f1045d56-5e22-4080-8e6c-13f50603d894 tempest-VolumesTransfersV357Test-714843873 None] Created volume successfully. Apr 29 06:46:00 devstack sudo[92020]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-eab68658-324e-460a-8687-8142b47b2460 tempest-SnapshotDependencyTests-1779789944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-14628d63-b2b2-47c2-b1d9-977f2f2d3094" returned: 0 in 0.623s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-eab68658-324e-460a-8687-8142b47b2460 tempest-SnapshotDependencyTests-1779789944 None] Lock "cinder-quobyte-14628d63-b2b2-47c2-b1d9-977f2f2d3094" released by "delete_volume" :: held 1.485s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:00 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-eab68658-324e-460a-8687-8142b47b2460 tempest-SnapshotDependencyTests-1779789944 None] Created reservations ['c51b4811-b5ad-4708-945c-33c3e7b22fd1', 'c1909ef0-9ef0-4afc-affb-ad3fc3175362', '9883970a-ffcf-4ec8-91e5-f25decf3c6c6', '9db7dbfe-bee6-4c43-993d-9f5d021de181'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:46:00 devstack sudo[92019]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2fd1f16f-faf8-4d79-b701-77667c0ee845 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f" returned: 0 in 0.761s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2fd1f16f-faf8-4d79-b701-77667c0ee845 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f.78b51c71-3e28-481c-a499-2ad4359250d0 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:00 devstack sudo[92028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f.78b51c71-3e28-481c-a499-2ad4359250d0 Apr 29 06:46:00 devstack sudo[92028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-eab68658-324e-460a-8687-8142b47b2460 tempest-SnapshotDependencyTests-1779789944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-eab68658-324e-460a-8687-8142b47b2460 tempest-SnapshotDependencyTests-1779789944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:00 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-eab68658-324e-460a-8687-8142b47b2460 tempest-SnapshotDependencyTests-1779789944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:46:00 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-eab68658-324e-460a-8687-8142b47b2460 tempest-SnapshotDependencyTests-1779789944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:46:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-eab68658-324e-460a-8687-8142b47b2460 tempest-SnapshotDependencyTests-1779789944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-eab68658-324e-460a-8687-8142b47b2460 tempest-SnapshotDependencyTests-1779789944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:00 devstack sudo[92030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:46:00 devstack sudo[92030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:01 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c076a755-0137-42a0-8071-c1d585c763f2 tempest-SnapshotDependencyTests-1779789944 None] Acquiring lock "cinder-045d7513-9059-45ee-afdd-b600bfe331f4-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:46:01 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c076a755-0137-42a0-8071-c1d585c763f2 tempest-SnapshotDependencyTests-1779789944 None] Lock "cinder-045d7513-9059-45ee-afdd-b600bfe331f4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:46:01 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c076a755-0137-42a0-8071-c1d585c763f2 tempest-SnapshotDependencyTests-1779789944 None] Acquiring lock "cinder-quobyte-045d7513-9059-45ee-afdd-b600bfe331f4" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:46:01 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c076a755-0137-42a0-8071-c1d585c763f2 tempest-SnapshotDependencyTests-1779789944 None] Lock "cinder-quobyte-045d7513-9059-45ee-afdd-b600bfe331f4" acquired by "delete_volume" :: waited 0.020s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:46:01 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66d132f-1059-4069-98ef-03e36b20dd9f]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:46:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c076a755-0137-42a0-8071-c1d585c763f2 tempest-SnapshotDependencyTests-1779789944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-045d7513-9059-45ee-afdd-b600bfe331f4 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:01 devstack sudo[92030]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-eab68658-324e-460a-8687-8142b47b2460 tempest-SnapshotDependencyTests-1779789944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.682s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:01 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-eab68658-324e-460a-8687-8142b47b2460 tempest-SnapshotDependencyTests-1779789944 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:46:01 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-eab68658-324e-460a-8687-8142b47b2460 tempest-SnapshotDependencyTests-1779789944 None] Deleted volume successfully. Apr 29 06:46:01 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-a21dcabe-2756-44f0-967e-de25ff70a9de tempest-VolumesTransfersV357Test-2102232431 None] Acquiring lock "cinder-4511425b-fb70-4c66-84a4-8c044b88bf4f-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:46:01 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-eab68658-324e-460a-8687-8142b47b2460 tempest-SnapshotDependencyTests-1779789944 None] Lock "cinder-14628d63-b2b2-47c2-b1d9-977f2f2d3094-delete_volume" released by "delete_volume" :: held 2.395s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:01 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-a21dcabe-2756-44f0-967e-de25ff70a9de tempest-VolumesTransfersV357Test-2102232431 None] Lock "cinder-4511425b-fb70-4c66-84a4-8c044b88bf4f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:46:01 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-a21dcabe-2756-44f0-967e-de25ff70a9de tempest-VolumesTransfersV357Test-2102232431 None] Acquiring lock "cinder-quobyte-4511425b-fb70-4c66-84a4-8c044b88bf4f" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:46:01 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-a21dcabe-2756-44f0-967e-de25ff70a9de tempest-VolumesTransfersV357Test-2102232431 None] Lock "cinder-quobyte-4511425b-fb70-4c66-84a4-8c044b88bf4f" acquired by "delete_volume" :: waited 0.021s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:46:01 devstack sudo[92028]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:01 devstack sudo[92036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-045d7513-9059-45ee-afdd-b600bfe331f4 Apr 29 06:46:01 devstack sudo[92036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2fd1f16f-faf8-4d79-b701-77667c0ee845 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f.78b51c71-3e28-481c-a499-2ad4359250d0" returned: 0 in 0.878s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2fd1f16f-faf8-4d79-b701-77667c0ee845 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f.78b51c71-3e28-481c-a499-2ad4359250d0 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:01 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[14139367-d221-4b33-997b-23b2491321b1]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:46:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a21dcabe-2756-44f0-967e-de25ff70a9de tempest-VolumesTransfersV357Test-2102232431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-4511425b-fb70-4c66-84a4-8c044b88bf4f {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:01 devstack sudo[92038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f.78b51c71-3e28-481c-a499-2ad4359250d0 Apr 29 06:46:01 devstack sudo[92038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:01 devstack sudo[92039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-4511425b-fb70-4c66-84a4-8c044b88bf4f Apr 29 06:46:01 devstack sudo[92039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:01 devstack sudo[92038]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2fd1f16f-faf8-4d79-b701-77667c0ee845 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f.78b51c71-3e28-481c-a499-2ad4359250d0" returned: 0 in 0.621s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:02 devstack sudo[92036]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c076a755-0137-42a0-8071-c1d585c763f2 tempest-SnapshotDependencyTests-1779789944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-045d7513-9059-45ee-afdd-b600bfe331f4" returned: 0 in 0.816s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c076a755-0137-42a0-8071-c1d585c763f2 tempest-SnapshotDependencyTests-1779789944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-045d7513-9059-45ee-afdd-b600bfe331f4 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:02 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2fd1f16f-faf8-4d79-b701-77667c0ee845 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Lock "cinder-quobyte-78b51c71-3e28-481c-a499-2ad4359250d0" released by "_delete_snapshot" :: held 3.265s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:02 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2fd1f16f-faf8-4d79-b701-77667c0ee845 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Lock "cinder-quobyte-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f" released by "delete_snapshot" :: held 3.293s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:02 devstack sudo[92050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-045d7513-9059-45ee-afdd-b600bfe331f4 Apr 29 06:46:02 devstack sudo[92050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:02 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-2fd1f16f-faf8-4d79-b701-77667c0ee845 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Created reservations ['6367b716-4cfe-49bc-b789-47bd2d67f9b8', 'ac6f35e1-ddd9-453b-a92d-a01e887b628f', 'f8423647-3b49-4f09-a63a-1c6bc280f841', 'c59233df-df40-4f66-bec3-8f12443edeae'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:46:02 devstack sudo[92039]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a21dcabe-2756-44f0-967e-de25ff70a9de tempest-VolumesTransfersV357Test-2102232431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-4511425b-fb70-4c66-84a4-8c044b88bf4f" returned: 0 in 0.777s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a21dcabe-2756-44f0-967e-de25ff70a9de tempest-VolumesTransfersV357Test-2102232431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-4511425b-fb70-4c66-84a4-8c044b88bf4f {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:02 devstack sudo[92052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-4511425b-fb70-4c66-84a4-8c044b88bf4f Apr 29 06:46:02 devstack sudo[92052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:02 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-2fd1f16f-faf8-4d79-b701-77667c0ee845 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Delete snapshot completed successfully. Apr 29 06:46:02 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2fd1f16f-faf8-4d79-b701-77667c0ee845 tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Lock "cinder-78b51c71-3e28-481c-a499-2ad4359250d0-delete_snapshot" released by "delete_snapshot" :: held 3.487s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:02 devstack sudo[92050]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c076a755-0137-42a0-8071-c1d585c763f2 tempest-SnapshotDependencyTests-1779789944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-045d7513-9059-45ee-afdd-b600bfe331f4" returned: 0 in 0.642s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:02 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c076a755-0137-42a0-8071-c1d585c763f2 tempest-SnapshotDependencyTests-1779789944 None] Lock "cinder-quobyte-045d7513-9059-45ee-afdd-b600bfe331f4" released by "delete_volume" :: held 1.509s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:02 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-c076a755-0137-42a0-8071-c1d585c763f2 tempest-SnapshotDependencyTests-1779789944 None] Created reservations ['133a189d-d5ef-4c21-ab3a-0f0f0d095fce', '4a793a7c-e478-42a1-93a2-4022476bd59d', 'f314eef1-6a94-45ac-88e2-705103bdd7fd', 'ef9729ed-33b9-4719-b261-bbe7f08a7a48'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:46:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c076a755-0137-42a0-8071-c1d585c763f2 tempest-SnapshotDependencyTests-1779789944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c076a755-0137-42a0-8071-c1d585c763f2 tempest-SnapshotDependencyTests-1779789944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:02 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c076a755-0137-42a0-8071-c1d585c763f2 tempest-SnapshotDependencyTests-1779789944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:46:02 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c076a755-0137-42a0-8071-c1d585c763f2 tempest-SnapshotDependencyTests-1779789944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:46:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c076a755-0137-42a0-8071-c1d585c763f2 tempest-SnapshotDependencyTests-1779789944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c076a755-0137-42a0-8071-c1d585c763f2 tempest-SnapshotDependencyTests-1779789944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:02 devstack sudo[92052]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a21dcabe-2756-44f0-967e-de25ff70a9de tempest-VolumesTransfersV357Test-2102232431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-4511425b-fb70-4c66-84a4-8c044b88bf4f" returned: 0 in 0.651s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:02 devstack sudo[92056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:46:02 devstack sudo[92056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:02 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-a21dcabe-2756-44f0-967e-de25ff70a9de tempest-VolumesTransfersV357Test-2102232431 None] Lock "cinder-quobyte-4511425b-fb70-4c66-84a4-8c044b88bf4f" released by "delete_volume" :: held 1.485s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:02 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-a21dcabe-2756-44f0-967e-de25ff70a9de tempest-VolumesTransfersV357Test-2102232431 None] Created reservations ['afad9f34-5c6f-4efd-9179-97694246e184', 'ce49e846-1294-46b6-a2cb-d56be37af70b', 'ddfdc52d-caa6-4409-a36a-da3f74fe669e', 'c9947367-75af-4f45-b4b2-e8bc0a333779'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:46:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a21dcabe-2756-44f0-967e-de25ff70a9de tempest-VolumesTransfersV357Test-2102232431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a21dcabe-2756-44f0-967e-de25ff70a9de tempest-VolumesTransfersV357Test-2102232431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:02 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-a21dcabe-2756-44f0-967e-de25ff70a9de tempest-VolumesTransfersV357Test-2102232431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:46:02 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-a21dcabe-2756-44f0-967e-de25ff70a9de tempest-VolumesTransfersV357Test-2102232431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:46:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a21dcabe-2756-44f0-967e-de25ff70a9de tempest-VolumesTransfersV357Test-2102232431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a21dcabe-2756-44f0-967e-de25ff70a9de tempest-VolumesTransfersV357Test-2102232431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:03 devstack sudo[92058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:46:03 devstack sudo[92058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:03 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ba18c6f6-e203-4b48-822e-562ca9b5c80f tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Acquiring lock "cinder-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:46:03 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ba18c6f6-e203-4b48-822e-562ca9b5c80f tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Lock "cinder-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:46:03 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ba18c6f6-e203-4b48-822e-562ca9b5c80f tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Acquiring lock "cinder-quobyte-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:46:03 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ba18c6f6-e203-4b48-822e-562ca9b5c80f tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Lock "cinder-quobyte-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f" acquired by "delete_volume" :: waited 0.024s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:46:03 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e481c9-0638-4f49-b54d-5e7fb000d31a]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:46:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ba18c6f6-e203-4b48-822e-562ca9b5c80f tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:03 devstack sudo[92060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f Apr 29 06:46:03 devstack sudo[92060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:03 devstack sudo[92056]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c076a755-0137-42a0-8071-c1d585c763f2 tempest-SnapshotDependencyTests-1779789944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.808s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:03 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-c076a755-0137-42a0-8071-c1d585c763f2 tempest-SnapshotDependencyTests-1779789944 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:46:03 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-c076a755-0137-42a0-8071-c1d585c763f2 tempest-SnapshotDependencyTests-1779789944 None] Deleted volume successfully. Apr 29 06:46:03 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c076a755-0137-42a0-8071-c1d585c763f2 tempest-SnapshotDependencyTests-1779789944 None] Lock "cinder-045d7513-9059-45ee-afdd-b600bfe331f4-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:03 devstack sudo[92058]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a21dcabe-2756-44f0-967e-de25ff70a9de tempest-VolumesTransfersV357Test-2102232431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.794s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:03 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-a21dcabe-2756-44f0-967e-de25ff70a9de tempest-VolumesTransfersV357Test-2102232431 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:46:03 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-a21dcabe-2756-44f0-967e-de25ff70a9de tempest-VolumesTransfersV357Test-2102232431 None] Deleted volume successfully. Apr 29 06:46:03 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-a21dcabe-2756-44f0-967e-de25ff70a9de tempest-VolumesTransfersV357Test-2102232431 None] Lock "cinder-4511425b-fb70-4c66-84a4-8c044b88bf4f-delete_volume" released by "delete_volume" :: held 2.515s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:04 devstack sudo[92060]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ba18c6f6-e203-4b48-822e-562ca9b5c80f tempest-VolumesSnapshotNegativeTestJSON-456681726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f" returned: 0 in 0.996s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ba18c6f6-e203-4b48-822e-562ca9b5c80f tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:04 devstack sudo[92067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f Apr 29 06:46:04 devstack sudo[92067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:04 devstack sudo[92067]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ba18c6f6-e203-4b48-822e-562ca9b5c80f tempest-VolumesSnapshotNegativeTestJSON-456681726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f" returned: 0 in 0.673s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:04 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ba18c6f6-e203-4b48-822e-562ca9b5c80f tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Lock "cinder-quobyte-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f" released by "delete_volume" :: held 1.749s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:04 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-ba18c6f6-e203-4b48-822e-562ca9b5c80f tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Created reservations ['639dc149-0162-4c93-b4f5-9b63e4618710', '0b7c7fd5-de44-408a-8ff6-427cffea4178', '4ff90b25-6334-4c1f-bfc0-5e1cf8584422', 'd872f03b-6949-46ec-93c6-9e6bf344af98'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:46:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-ba18c6f6-e203-4b48-822e-562ca9b5c80f tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-ba18c6f6-e203-4b48-822e-562ca9b5c80f tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:05 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-ba18c6f6-e203-4b48-822e-562ca9b5c80f tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:46:05 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-ba18c6f6-e203-4b48-822e-562ca9b5c80f tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:46:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-ba18c6f6-e203-4b48-822e-562ca9b5c80f tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ba18c6f6-e203-4b48-822e-562ca9b5c80f tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:05 devstack sudo[92070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:46:05 devstack sudo[92070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:05 devstack sudo[92070]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ba18c6f6-e203-4b48-822e-562ca9b5c80f tempest-VolumesSnapshotNegativeTestJSON-456681726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.788s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:05 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-ba18c6f6-e203-4b48-822e-562ca9b5c80f tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:46:05 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-ba18c6f6-e203-4b48-822e-562ca9b5c80f tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Deleted volume successfully. Apr 29 06:46:05 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ba18c6f6-e203-4b48-822e-562ca9b5c80f tempest-VolumesSnapshotNegativeTestJSON-456681726 None] Lock "cinder-8d1c373c-27bc-47a4-bbc2-cd742de7cf3f-delete_volume" released by "delete_volume" :: held 2.791s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:09 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:46:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Flow 'volume_create_manager' (6deac75b-a271-4e2b-a385-82b2a3959100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:46:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a76cb94-2206-484b-a124-2570ac85d25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a76cb94-2206-484b-a124-2570ac85d25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-681808265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9948517-2582-4642-b250-9b6e708033be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccce4575585043b29433f55978fe8c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:46:09Z,use_quota=True,user_id='d4ea72c9da2b4831a40adb4aa78b207d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b100125-2416-42b5-835e-3c053e7308b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b100125-2416-42b5-835e-3c053e7308b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c63eceae-9cbc-4824-87f2-99f9ce41cc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c63eceae-9cbc-4824-87f2-99f9ce41cc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9948517-2582-4642-b250-9b6e708033be', 'volume_name': 'volume-c9948517-2582-4642-b250-9b6e708033be', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1745f33c-3c75-4619-a1b3-5af3cadb974e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1745f33c-3c75-4619-a1b3-5af3cadb974e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec78427-534b-4d31-8a9f-c26f8cc26444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:09 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Volume c9948517-2582-4642-b250-9b6e708033be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9948517-2582-4642-b250-9b6e708033be', 'volume_size': 1} Apr 29 06:46:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:09 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-681808265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9948517-2582-4642-b250-9b6e708033be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccce4575585043b29433f55978fe8c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:46:09Z,use_quota=True,user_id='d4ea72c9da2b4831a40adb4aa78b207d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:46:09 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Creating volume c9948517-2582-4642-b250-9b6e708033be {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:46:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:09 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:46:09 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:46:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:09 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:46:09 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:46:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:09 devstack sudo[92076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be 1073741824 Apr 29 06:46:09 devstack sudo[92076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:10 devstack sudo[92076]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be 1073741824" returned: 0 in 0.870s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:10 devstack sudo[92083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be Apr 29 06:46:10 devstack sudo[92083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:10 devstack sudo[92083]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be" returned: 0 in 0.700s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:10 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:46:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:11 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec78427-534b-4d31-8a9f-c26f8cc26444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9948517-2582-4642-b250-9b6e708033be', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:11 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be59c84c-0fea-4334-abfb-21cb1327cbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:11 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Volume volume-c9948517-2582-4642-b250-9b6e708033be (c9948517-2582-4642-b250-9b6e708033be): created successfully Apr 29 06:46:11 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be59c84c-0fea-4334-abfb-21cb1327cbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:11 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Flow 'volume_create_manager' (6deac75b-a271-4e2b-a385-82b2a3959100) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:46:11 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-1f79b379-6482-4332-9af1-8ae94f58d6ee tempest-CreateVolumesFromSnapshotTest-2022432072 None] Created volume successfully. Apr 29 06:46:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2e939f45-22ff-40c5-8c12-b71460d0df07 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2e939f45-22ff-40c5-8c12-b71460d0df07 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:11 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-2e939f45-22ff-40c5-8c12-b71460d0df07 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Creating offline snapshot 847df34e-242d-4630-911b-6aa3b40d3f60 of volume c9948517-2582-4642-b250-9b6e708033be {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:46:11 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e52aecb-753e-457a-852b-3a6e4a07d029]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:46:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2e939f45-22ff-40c5-8c12-b71460d0df07 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:11 devstack sudo[92086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be Apr 29 06:46:11 devstack sudo[92086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:12 devstack sudo[92086]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2e939f45-22ff-40c5-8c12-b71460d0df07 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be" returned: 0 in 0.862s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2e939f45-22ff-40c5-8c12-b71460d0df07 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be.847df34e-242d-4630-911b-6aa3b40d3f60 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:12 devstack sudo[92092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be.847df34e-242d-4630-911b-6aa3b40d3f60 1G Apr 29 06:46:12 devstack sudo[92092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:13 devstack sudo[92092]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2e939f45-22ff-40c5-8c12-b71460d0df07 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be.847df34e-242d-4630-911b-6aa3b40d3f60 1G" returned: 0 in 0.913s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2e939f45-22ff-40c5-8c12-b71460d0df07 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9948517-2582-4642-b250-9b6e708033be -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be.847df34e-242d-4630-911b-6aa3b40d3f60 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:13 devstack sudo[92097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9948517-2582-4642-b250-9b6e708033be -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be.847df34e-242d-4630-911b-6aa3b40d3f60 Apr 29 06:46:13 devstack sudo[92097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:14 devstack sudo[92097]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2e939f45-22ff-40c5-8c12-b71460d0df07 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9948517-2582-4642-b250-9b6e708033be -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be.847df34e-242d-4630-911b-6aa3b40d3f60" returned: 0 in 0.777s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:14 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-2e939f45-22ff-40c5-8c12-b71460d0df07 tempest-CreateVolumesFromSnapshotTest-2022432072 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be.847df34e-242d-4630-911b-6aa3b40d3f60 is being set with open permissions: ugo+rw Apr 29 06:46:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2e939f45-22ff-40c5-8c12-b71460d0df07 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be.847df34e-242d-4630-911b-6aa3b40d3f60 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:14 devstack sudo[92102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be.847df34e-242d-4630-911b-6aa3b40d3f60 Apr 29 06:46:14 devstack sudo[92102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:14 devstack sudo[92102]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2e939f45-22ff-40c5-8c12-b71460d0df07 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be.847df34e-242d-4630-911b-6aa3b40d3f60" returned: 0 in 0.601s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2e939f45-22ff-40c5-8c12-b71460d0df07 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:14 devstack sudo[92105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be.info Apr 29 06:46:14 devstack sudo[92105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:15 devstack sudo[92105]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2e939f45-22ff-40c5-8c12-b71460d0df07 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be.info" returned: 0 in 0.716s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:15 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-2e939f45-22ff-40c5-8c12-b71460d0df07 tempest-CreateVolumesFromSnapshotTest-2022432072 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be.info is being set with open permissions: ugo+rw Apr 29 06:46:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2e939f45-22ff-40c5-8c12-b71460d0df07 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:15 devstack sudo[92108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be.info Apr 29 06:46:15 devstack sudo[92108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:16 devstack sudo[92108]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2e939f45-22ff-40c5-8c12-b71460d0df07 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be.info" returned: 0 in 0.594s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2e939f45-22ff-40c5-8c12-b71460d0df07 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.596s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:16 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-2e939f45-22ff-40c5-8c12-b71460d0df07 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Create snapshot completed successfully Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Flow 'volume_create_manager' (a552a6c7-ae3b-4d09-be9a-bf5b1accbb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac455dce-c865-4aa4-96a5-14c59410c1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac455dce-c865-4aa4-96a5-14c59410c1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-507609335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ec9268-cda0-484f-b6dd-65b433362deb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccce4575585043b29433f55978fe8c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:46:17Z,use_quota=True,user_id='d4ea72c9da2b4831a40adb4aa78b207d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f78af1-734b-4234-8a03-e87d362628ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f78af1-734b-4234-8a03-e87d362628ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3a7b26-b761-4eaa-817c-92a4e136c702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3a7b26-b761-4eaa-817c-92a4e136c702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8ec9268-cda0-484f-b6dd-65b433362deb', 'volume_name': 'volume-d8ec9268-cda0-484f-b6dd-65b433362deb', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6f4c21-162c-4ed9-bc0a-c99ebb43eac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6f4c21-162c-4ed9-bc0a-c99ebb43eac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7127a335-f554-4e23-ad8e-ff4da7de963c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:17 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Volume d8ec9268-cda0-484f-b6dd-65b433362deb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8ec9268-cda0-484f-b6dd-65b433362deb', 'volume_size': 1} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-507609335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ec9268-cda0-484f-b6dd-65b433362deb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccce4575585043b29433f55978fe8c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:46:17Z,use_quota=True,user_id='d4ea72c9da2b4831a40adb4aa78b207d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Creating volume d8ec9268-cda0-484f-b6dd-65b433362deb {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:46:17 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d8ec9268-cda0-484f-b6dd-65b433362deb 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:17 devstack sudo[92112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d8ec9268-cda0-484f-b6dd-65b433362deb 1073741824 Apr 29 06:46:17 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Flow 'volume_create_manager' (c47f5b53-13e2-4f78-a82c-a8735151bd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eed08a9-4e6d-4b00-8090-8520451bb400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eed08a9-4e6d-4b00-8090-8520451bb400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2119384352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b46dc26a-e0a0-4fad-85c6-b22ec9ccd4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccce4575585043b29433f55978fe8c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:46:18Z,use_quota=True,user_id='d4ea72c9da2b4831a40adb4aa78b207d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7006b968-0a4f-4fff-9aff-62be3d143ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7006b968-0a4f-4fff-9aff-62be3d143ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97dada13-3e50-42a2-84c9-0d01647eca0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97dada13-3e50-42a2-84c9-0d01647eca0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b46dc26a-e0a0-4fad-85c6-b22ec9ccd4e5', 'volume_name': 'volume-b46dc26a-e0a0-4fad-85c6-b22ec9ccd4e5', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9d9f2c7-7227-4717-8def-b743a7c28c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9d9f2c7-7227-4717-8def-b743a7c28c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb3ceac3-79c4-4294-9d98-4ccca8e26566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:17 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Volume b46dc26a-e0a0-4fad-85c6-b22ec9ccd4e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b46dc26a-e0a0-4fad-85c6-b22ec9ccd4e5', 'volume_size': 1} Apr 29 06:46:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:18 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:46:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Flow 'volume_create_manager' (a8ddd223-4753-45c9-963d-f988805b239c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:46:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a54e1499-1158-43ee-a296-5d4cadc75d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a54e1499-1158-43ee-a296-5d4cadc75d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-786871633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54331fac-0825-44a1-820a-9cab1002bc99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccce4575585043b29433f55978fe8c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:46:18Z,use_quota=True,user_id='d4ea72c9da2b4831a40adb4aa78b207d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de969c68-8d2b-441b-b55b-45a582b74f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de969c68-8d2b-441b-b55b-45a582b74f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa44653-498b-4c95-85b7-381bfadd21e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa44653-498b-4c95-85b7-381bfadd21e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54331fac-0825-44a1-820a-9cab1002bc99', 'volume_name': 'volume-54331fac-0825-44a1-820a-9cab1002bc99', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (546755de-eb29-49d4-936c-0030de62cf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (546755de-eb29-49d4-936c-0030de62cf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77be5b61-8cb9-432a-89b3-8549c526dbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:18 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Volume 54331fac-0825-44a1-820a-9cab1002bc99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54331fac-0825-44a1-820a-9cab1002bc99', 'volume_size': 1} Apr 29 06:46:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:18 devstack sudo[92112]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d8ec9268-cda0-484f-b6dd-65b433362deb 1073741824" returned: 0 in 1.140s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:18 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:UPDATE=133,cinder:SELECT=89,cinder:INSERT=31,cinder:DELETE=13 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:46:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d8ec9268-cda0-484f-b6dd-65b433362deb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:18 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:46:18 devstack sudo[92118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d8ec9268-cda0-484f-b6dd-65b433362deb Apr 29 06:46:18 devstack sudo[92118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Flow 'volume_create_manager' (118c45d3-810a-44e3-b726-de2bf7c8a8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:46:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b0de62-d646-4c1d-8ed5-0e0c0907f7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:18 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:SELECT=109,cinder:DELETE=9,cinder:INSERT=32,cinder:UPDATE=123 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:46:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b0de62-d646-4c1d-8ed5-0e0c0907f7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-38191927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=011deee3-4576-440e-a34d-a37a79cf5f86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccce4575585043b29433f55978fe8c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:46:19Z,use_quota=True,user_id='d4ea72c9da2b4831a40adb4aa78b207d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdffe6b4-0bf2-4b4e-9f3d-695c19aa664a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdffe6b4-0bf2-4b4e-9f3d-695c19aa664a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12368aa-457b-4f70-967e-3aa08773b30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12368aa-457b-4f70-967e-3aa08773b30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '011deee3-4576-440e-a34d-a37a79cf5f86', 'volume_name': 'volume-011deee3-4576-440e-a34d-a37a79cf5f86', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717bf9c4-20bb-43c9-afd2-1363a8eff5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717bf9c4-20bb-43c9-afd2-1363a8eff5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caaf3c58-733f-4aef-bf2d-b04a0b5c372c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:18 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Volume 011deee3-4576-440e-a34d-a37a79cf5f86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-011deee3-4576-440e-a34d-a37a79cf5f86', 'volume_size': 1} Apr 29 06:46:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Flow 'volume_create_manager' (14dbe801-0fc9-43fb-a751-c7bb70169d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c46a98-fa8a-404b-86c2-1177b350442f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c46a98-fa8a-404b-86c2-1177b350442f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-255039082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91fbe5f8-8217-4e33-adfd-07e8079512c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccce4575585043b29433f55978fe8c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:46:19Z,use_quota=True,user_id='d4ea72c9da2b4831a40adb4aa78b207d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (146cb7e2-b85b-4b8a-94ac-33c956d181e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (146cb7e2-b85b-4b8a-94ac-33c956d181e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e81605c7-0158-4d2c-83ce-c09b25de453b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e81605c7-0158-4d2c-83ce-c09b25de453b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91fbe5f8-8217-4e33-adfd-07e8079512c1', 'volume_name': 'volume-91fbe5f8-8217-4e33-adfd-07e8079512c1', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0047a45-48c8-483c-8dc3-1bfa122ec857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0047a45-48c8-483c-8dc3-1bfa122ec857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c312ee2-ff49-45f4-b9d4-93684cdcb7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:19 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Volume 91fbe5f8-8217-4e33-adfd-07e8079512c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91fbe5f8-8217-4e33-adfd-07e8079512c1', 'volume_size': 1} Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:19 devstack sudo[92118]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d8ec9268-cda0-484f-b6dd-65b433362deb" returned: 0 in 0.770s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.982s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.521s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2119384352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b46dc26a-e0a0-4fad-85c6-b22ec9ccd4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccce4575585043b29433f55978fe8c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:46:18Z,use_quota=True,user_id='d4ea72c9da2b4831a40adb4aa78b207d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Creating volume b46dc26a-e0a0-4fad-85c6-b22ec9ccd4e5 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:46:19 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b46dc26a-e0a0-4fad-85c6-b22ec9ccd4e5 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7127a335-f554-4e23-ad8e-ff4da7de963c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8ec9268-cda0-484f-b6dd-65b433362deb', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:19 devstack sudo[92121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b46dc26a-e0a0-4fad-85c6-b22ec9ccd4e5 1073741824 Apr 29 06:46:19 devstack sudo[92121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31815cd6-c957-4ca2-b708-5b13fe00ca9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:19 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Volume volume-d8ec9268-cda0-484f-b6dd-65b433362deb (d8ec9268-cda0-484f-b6dd-65b433362deb): created successfully Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31815cd6-c957-4ca2-b708-5b13fe00ca9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:19 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Flow 'volume_create_manager' (a552a6c7-ae3b-4d09-be9a-bf5b1accbb88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:46:19 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-a4294900-59b8-4822-b94f-89b7954c1327 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Created volume successfully. Apr 29 06:46:20 devstack sudo[92121]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b46dc26a-e0a0-4fad-85c6-b22ec9ccd4e5 1073741824" returned: 0 in 1.001s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b46dc26a-e0a0-4fad-85c6-b22ec9ccd4e5 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:20 devstack sudo[92128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b46dc26a-e0a0-4fad-85c6-b22ec9ccd4e5 Apr 29 06:46:20 devstack sudo[92128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:21 devstack sudo[92128]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b46dc26a-e0a0-4fad-85c6-b22ec9ccd4e5" returned: 0 in 0.659s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.845s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-786871633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54331fac-0825-44a1-820a-9cab1002bc99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccce4575585043b29433f55978fe8c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:46:18Z,use_quota=True,user_id='d4ea72c9da2b4831a40adb4aa78b207d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Creating volume 54331fac-0825-44a1-820a-9cab1002bc99 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:46:21 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54331fac-0825-44a1-820a-9cab1002bc99 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:21 devstack sudo[92132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54331fac-0825-44a1-820a-9cab1002bc99 1073741824 Apr 29 06:46:21 devstack sudo[92132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb3ceac3-79c4-4294-9d98-4ccca8e26566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b46dc26a-e0a0-4fad-85c6-b22ec9ccd4e5', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e28b8184-000c-4c1d-8edf-51c48db114b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:21 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Volume volume-b46dc26a-e0a0-4fad-85c6-b22ec9ccd4e5 (b46dc26a-e0a0-4fad-85c6-b22ec9ccd4e5): created successfully Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e28b8184-000c-4c1d-8edf-51c48db114b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Flow 'volume_create_manager' (c47f5b53-13e2-4f78-a82c-a8735151bd98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:46:21 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-5f64f34f-db49-4bbc-8c48-6058366b99a8 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Created volume successfully. Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Flow 'volume_create_manager' (d29384b9-f626-49a7-852c-c7d442721b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ab8a51-6bf5-4c99-ad2a-b661d82e058f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ab8a51-6bf5-4c99-ad2a-b661d82e058f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-834631060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0a4244-7e80-4b88-abef-1ddd66fb470b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e102afc6479b4a4ca405f1ac855c6f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:46:21Z,use_quota=True,user_id='ff4a45a9cb22452c8aebabc96c33aab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c84c71-b5a8-4419-8962-f97f2eb39325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c84c71-b5a8-4419-8962-f97f2eb39325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13bad02d-b2c2-4fcb-81ef-2d911b5001c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13bad02d-b2c2-4fcb-81ef-2d911b5001c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be0a4244-7e80-4b88-abef-1ddd66fb470b', 'volume_name': 'volume-be0a4244-7e80-4b88-abef-1ddd66fb470b', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dc5875c-b6f5-4797-9304-d95288adf7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dc5875c-b6f5-4797-9304-d95288adf7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e88e1e-ca7a-41ec-bbd7-51dbb749fce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:21 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Volume be0a4244-7e80-4b88-abef-1ddd66fb470b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be0a4244-7e80-4b88-abef-1ddd66fb470b', 'volume_size': 1} Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:21 devstack sudo[92132]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54331fac-0825-44a1-820a-9cab1002bc99 1073741824" returned: 0 in 0.823s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54331fac-0825-44a1-820a-9cab1002bc99 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:21 devstack sudo[92138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54331fac-0825-44a1-820a-9cab1002bc99 Apr 29 06:46:21 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:22 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54331fac-0825-44a1-820a-9cab1002bc99" returned: 0 in 0.600s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:46:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.851s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-38191927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=011deee3-4576-440e-a34d-a37a79cf5f86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccce4575585043b29433f55978fe8c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:46:19Z,use_quota=True,user_id='d4ea72c9da2b4831a40adb4aa78b207d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:46:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Creating volume 011deee3-4576-440e-a34d-a37a79cf5f86 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:46:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:46:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:46:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:22 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:46:22 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:46:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-011deee3-4576-440e-a34d-a37a79cf5f86 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:22 devstack sudo[92141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-011deee3-4576-440e-a34d-a37a79cf5f86 1073741824 Apr 29 06:46:22 devstack sudo[92141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77be5b61-8cb9-432a-89b3-8549c526dbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54331fac-0825-44a1-820a-9cab1002bc99', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b325090-f1ad-418c-8742-03ce32f563ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:22 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Volume volume-54331fac-0825-44a1-820a-9cab1002bc99 (54331fac-0825-44a1-820a-9cab1002bc99): created successfully Apr 29 06:46:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b325090-f1ad-418c-8742-03ce32f563ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:22 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Flow 'volume_create_manager' (a8ddd223-4753-45c9-963d-f988805b239c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:46:22 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-d430b637-b918-452c-b33a-910c9155a731 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Created volume successfully. Apr 29 06:46:23 devstack sudo[92141]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-011deee3-4576-440e-a34d-a37a79cf5f86 1073741824" returned: 0 in 0.767s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-011deee3-4576-440e-a34d-a37a79cf5f86 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:23 devstack sudo[92147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-011deee3-4576-440e-a34d-a37a79cf5f86 Apr 29 06:46:23 devstack sudo[92147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:23 devstack sudo[92147]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-011deee3-4576-440e-a34d-a37a79cf5f86" returned: 0 in 0.595s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:23 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:46:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.846s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:23 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-255039082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91fbe5f8-8217-4e33-adfd-07e8079512c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccce4575585043b29433f55978fe8c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:46:19Z,use_quota=True,user_id='d4ea72c9da2b4831a40adb4aa78b207d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:46:23 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Creating volume 91fbe5f8-8217-4e33-adfd-07e8079512c1 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:46:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:23 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:46:23 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:46:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:23 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:46:23 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:46:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-91fbe5f8-8217-4e33-adfd-07e8079512c1 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:24 devstack sudo[92150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-91fbe5f8-8217-4e33-adfd-07e8079512c1 1073741824 Apr 29 06:46:24 devstack sudo[92150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:24 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caaf3c58-733f-4aef-bf2d-b04a0b5c372c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-011deee3-4576-440e-a34d-a37a79cf5f86', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:24 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6238e891-5ae9-4e1f-9d69-c84c7823bc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:24 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Volume volume-011deee3-4576-440e-a34d-a37a79cf5f86 (011deee3-4576-440e-a34d-a37a79cf5f86): created successfully Apr 29 06:46:24 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6238e891-5ae9-4e1f-9d69-c84c7823bc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:24 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Flow 'volume_create_manager' (118c45d3-810a-44e3-b726-de2bf7c8a8b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:46:24 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-ff411825-c1e0-412a-886d-93ffc2b08b04 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Created volume successfully. Apr 29 06:46:24 devstack sudo[92150]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-91fbe5f8-8217-4e33-adfd-07e8079512c1 1073741824" returned: 0 in 0.779s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-91fbe5f8-8217-4e33-adfd-07e8079512c1 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:24 devstack sudo[92156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-91fbe5f8-8217-4e33-adfd-07e8079512c1 Apr 29 06:46:24 devstack sudo[92156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:25 devstack sudo[92156]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-91fbe5f8-8217-4e33-adfd-07e8079512c1" returned: 0 in 0.603s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:25 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:46:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.079s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:25 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-834631060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0a4244-7e80-4b88-abef-1ddd66fb470b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e102afc6479b4a4ca405f1ac855c6f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:46:21Z,use_quota=True,user_id='ff4a45a9cb22452c8aebabc96c33aab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:46:25 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Creating volume be0a4244-7e80-4b88-abef-1ddd66fb470b {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:46:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:25 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:46:25 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:46:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:25 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:46:25 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:46:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c312ee2-ff49-45f4-b9d4-93684cdcb7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91fbe5f8-8217-4e33-adfd-07e8079512c1', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c75688-729e-45db-91d7-3c12d472233b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:25 devstack sudo[92193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b 1073741824 Apr 29 06:46:25 devstack sudo[92193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:25 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Volume volume-91fbe5f8-8217-4e33-adfd-07e8079512c1 (91fbe5f8-8217-4e33-adfd-07e8079512c1): created successfully Apr 29 06:46:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c75688-729e-45db-91d7-3c12d472233b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Flow 'volume_create_manager' (14dbe801-0fc9-43fb-a751-c7bb70169d0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:46:25 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-064764b6-ca8d-46cb-9b9f-3e291f7228f3 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Created volume successfully. Apr 29 06:46:25 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-005dd745-1b69-495a-bfd5-1d21111884f0 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "cinder-91fbe5f8-8217-4e33-adfd-07e8079512c1-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:46:25 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-005dd745-1b69-495a-bfd5-1d21111884f0 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-91fbe5f8-8217-4e33-adfd-07e8079512c1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:46:25 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-005dd745-1b69-495a-bfd5-1d21111884f0 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "cinder-quobyte-91fbe5f8-8217-4e33-adfd-07e8079512c1" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:46:25 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-005dd745-1b69-495a-bfd5-1d21111884f0 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-quobyte-91fbe5f8-8217-4e33-adfd-07e8079512c1" acquired by "delete_volume" :: waited 0.015s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:46:25 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8c4103-73cd-4d75-adbb-5822b6d01c10]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:46:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-005dd745-1b69-495a-bfd5-1d21111884f0 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-91fbe5f8-8217-4e33-adfd-07e8079512c1 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:25 devstack sudo[92197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-91fbe5f8-8217-4e33-adfd-07e8079512c1 Apr 29 06:46:25 devstack sudo[92197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:26 devstack sudo[92193]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b 1073741824" returned: 0 in 0.907s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:26 devstack sudo[92202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b Apr 29 06:46:26 devstack sudo[92202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:26 devstack sudo[92197]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-005dd745-1b69-495a-bfd5-1d21111884f0 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-91fbe5f8-8217-4e33-adfd-07e8079512c1" returned: 0 in 0.742s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-005dd745-1b69-495a-bfd5-1d21111884f0 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-91fbe5f8-8217-4e33-adfd-07e8079512c1 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:26 devstack sudo[92209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-91fbe5f8-8217-4e33-adfd-07e8079512c1 Apr 29 06:46:26 devstack sudo[92209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:26 devstack sudo[92202]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b" returned: 0 in 0.606s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:26 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:46:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e88e1e-ca7a-41ec-bbd7-51dbb749fce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be0a4244-7e80-4b88-abef-1ddd66fb470b', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93cf503d-f779-4b55-8c3c-402a1fa00e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:27 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Volume volume-be0a4244-7e80-4b88-abef-1ddd66fb470b (be0a4244-7e80-4b88-abef-1ddd66fb470b): created successfully Apr 29 06:46:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93cf503d-f779-4b55-8c3c-402a1fa00e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Flow 'volume_create_manager' (d29384b9-f626-49a7-852c-c7d442721b03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:46:27 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-4c236391-499c-4887-9811-30e8d431b2fc tempest-VolumesActionsTest-1468389369 None] Created volume successfully. Apr 29 06:46:27 devstack sudo[92209]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-005dd745-1b69-495a-bfd5-1d21111884f0 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-91fbe5f8-8217-4e33-adfd-07e8079512c1" returned: 0 in 0.606s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:27 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-005dd745-1b69-495a-bfd5-1d21111884f0 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-quobyte-91fbe5f8-8217-4e33-adfd-07e8079512c1" released by "delete_volume" :: held 1.387s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:27 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-005dd745-1b69-495a-bfd5-1d21111884f0 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Created reservations ['d49c755e-bc1b-4e7a-891f-8756c9c29393', '9b2259df-eb68-45e1-ba54-000fe1182984', '178677dc-c59e-4506-99f7-1fa49500aae4', '85e7f069-ffaf-4ef5-819f-e19a1103ea04'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:46:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-005dd745-1b69-495a-bfd5-1d21111884f0 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-005dd745-1b69-495a-bfd5-1d21111884f0 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:27 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-005dd745-1b69-495a-bfd5-1d21111884f0 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:46:27 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-005dd745-1b69-495a-bfd5-1d21111884f0 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:46:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-005dd745-1b69-495a-bfd5-1d21111884f0 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-005dd745-1b69-495a-bfd5-1d21111884f0 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:27 devstack sudo[92213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:46:27 devstack sudo[92213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:27 devstack sudo[92213]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-005dd745-1b69-495a-bfd5-1d21111884f0 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.597s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:27 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-005dd745-1b69-495a-bfd5-1d21111884f0 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:46:27 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-005dd745-1b69-495a-bfd5-1d21111884f0 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Deleted volume successfully. Apr 29 06:46:27 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-005dd745-1b69-495a-bfd5-1d21111884f0 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-91fbe5f8-8217-4e33-adfd-07e8079512c1-delete_volume" released by "delete_volume" :: held 2.180s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:27 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-a328ff85-714d-4090-b93b-078d39053237 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "cinder-011deee3-4576-440e-a34d-a37a79cf5f86-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:46:27 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-a328ff85-714d-4090-b93b-078d39053237 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-011deee3-4576-440e-a34d-a37a79cf5f86-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:46:28 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-a328ff85-714d-4090-b93b-078d39053237 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "cinder-quobyte-011deee3-4576-440e-a34d-a37a79cf5f86" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:46:28 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-a328ff85-714d-4090-b93b-078d39053237 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-quobyte-011deee3-4576-440e-a34d-a37a79cf5f86" acquired by "delete_volume" :: waited 0.023s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:46:28 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3eef656-b244-4b80-965f-cafa0a387aa7]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:46:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a328ff85-714d-4090-b93b-078d39053237 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-011deee3-4576-440e-a34d-a37a79cf5f86 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:28 devstack sudo[92216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-011deee3-4576-440e-a34d-a37a79cf5f86 Apr 29 06:46:28 devstack sudo[92216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:28 devstack sudo[92216]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a328ff85-714d-4090-b93b-078d39053237 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-011deee3-4576-440e-a34d-a37a79cf5f86" returned: 0 in 0.784s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a328ff85-714d-4090-b93b-078d39053237 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-011deee3-4576-440e-a34d-a37a79cf5f86 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:28 devstack sudo[92224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-011deee3-4576-440e-a34d-a37a79cf5f86 Apr 29 06:46:28 devstack sudo[92224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:29 devstack sudo[92224]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a328ff85-714d-4090-b93b-078d39053237 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-011deee3-4576-440e-a34d-a37a79cf5f86" returned: 0 in 0.616s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:29 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-a328ff85-714d-4090-b93b-078d39053237 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-quobyte-011deee3-4576-440e-a34d-a37a79cf5f86" released by "delete_volume" :: held 1.443s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:29 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-a328ff85-714d-4090-b93b-078d39053237 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Created reservations ['a7ee5701-e8fe-4643-a32a-6d4f05d3ba27', 'a8ee59b1-6461-438c-8379-927f04232df5', 'f5294926-dfef-4434-a05e-92ffd78da917', '4c4de651-aef7-4aae-b322-e7bc5b4ee6ef'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:46:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a328ff85-714d-4090-b93b-078d39053237 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a328ff85-714d-4090-b93b-078d39053237 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:29 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-a328ff85-714d-4090-b93b-078d39053237 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:46:29 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-a328ff85-714d-4090-b93b-078d39053237 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:46:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a328ff85-714d-4090-b93b-078d39053237 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a328ff85-714d-4090-b93b-078d39053237 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:29 devstack sudo[92228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:46:29 devstack sudo[92228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:30 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4faf58b1-15be-4c74-a13b-cb531345cd2a tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "cinder-54331fac-0825-44a1-820a-9cab1002bc99-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:46:30 devstack sudo[92228]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a328ff85-714d-4090-b93b-078d39053237 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.609s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:30 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-a328ff85-714d-4090-b93b-078d39053237 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:46:30 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4faf58b1-15be-4c74-a13b-cb531345cd2a tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-54331fac-0825-44a1-820a-9cab1002bc99-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:46:30 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-a328ff85-714d-4090-b93b-078d39053237 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Deleted volume successfully. Apr 29 06:46:30 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-a328ff85-714d-4090-b93b-078d39053237 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-011deee3-4576-440e-a34d-a37a79cf5f86-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:30 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4faf58b1-15be-4c74-a13b-cb531345cd2a tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "cinder-quobyte-54331fac-0825-44a1-820a-9cab1002bc99" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:46:30 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4faf58b1-15be-4c74-a13b-cb531345cd2a tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-quobyte-54331fac-0825-44a1-820a-9cab1002bc99" acquired by "delete_volume" :: waited 0.019s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:46:30 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ae2f2e-56eb-4420-980d-ab4bb35e5378]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:46:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4faf58b1-15be-4c74-a13b-cb531345cd2a tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54331fac-0825-44a1-820a-9cab1002bc99 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:30 devstack sudo[92231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54331fac-0825-44a1-820a-9cab1002bc99 Apr 29 06:46:30 devstack sudo[92231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:31 devstack sudo[92231]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4faf58b1-15be-4c74-a13b-cb531345cd2a tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54331fac-0825-44a1-820a-9cab1002bc99" returned: 0 in 0.729s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4faf58b1-15be-4c74-a13b-cb531345cd2a tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54331fac-0825-44a1-820a-9cab1002bc99 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:31 devstack sudo[92236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54331fac-0825-44a1-820a-9cab1002bc99 Apr 29 06:46:31 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:31 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4faf58b1-15be-4c74-a13b-cb531345cd2a tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54331fac-0825-44a1-820a-9cab1002bc99" returned: 0 in 0.604s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:31 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4faf58b1-15be-4c74-a13b-cb531345cd2a tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-quobyte-54331fac-0825-44a1-820a-9cab1002bc99" released by "delete_volume" :: held 1.371s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:31 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-4faf58b1-15be-4c74-a13b-cb531345cd2a tempest-CreateVolumesFromSnapshotTest-2022432072 None] Created reservations ['90d3e3a7-e373-44e1-9802-b4f17b265e26', '5350c052-b1e3-443a-a23b-62674a5ed356', 'e818c39f-07f3-46be-9d3a-782f16f47ccc', 'f47bbf09-0fa7-4e34-90b1-a4a4084c242e'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:46:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4faf58b1-15be-4c74-a13b-cb531345cd2a tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4faf58b1-15be-4c74-a13b-cb531345cd2a tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:31 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4faf58b1-15be-4c74-a13b-cb531345cd2a tempest-CreateVolumesFromSnapshotTest-2022432072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:46:31 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4faf58b1-15be-4c74-a13b-cb531345cd2a tempest-CreateVolumesFromSnapshotTest-2022432072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:46:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4faf58b1-15be-4c74-a13b-cb531345cd2a tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4faf58b1-15be-4c74-a13b-cb531345cd2a tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:31 devstack sudo[92240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:46:31 devstack sudo[92240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:32 devstack sudo[92240]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4faf58b1-15be-4c74-a13b-cb531345cd2a tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.634s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:32 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-4faf58b1-15be-4c74-a13b-cb531345cd2a tempest-CreateVolumesFromSnapshotTest-2022432072 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:46:32 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-4faf58b1-15be-4c74-a13b-cb531345cd2a tempest-CreateVolumesFromSnapshotTest-2022432072 None] Deleted volume successfully. Apr 29 06:46:32 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-98ba1b90-cfa3-4607-9eb9-205e8898925c tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "cinder-b46dc26a-e0a0-4fad-85c6-b22ec9ccd4e5-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:46:32 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-98ba1b90-cfa3-4607-9eb9-205e8898925c tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-b46dc26a-e0a0-4fad-85c6-b22ec9ccd4e5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:46:32 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4faf58b1-15be-4c74-a13b-cb531345cd2a tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-54331fac-0825-44a1-820a-9cab1002bc99-delete_volume" released by "delete_volume" :: held 2.226s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:32 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-98ba1b90-cfa3-4607-9eb9-205e8898925c tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "cinder-quobyte-b46dc26a-e0a0-4fad-85c6-b22ec9ccd4e5" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:46:32 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-98ba1b90-cfa3-4607-9eb9-205e8898925c tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-quobyte-b46dc26a-e0a0-4fad-85c6-b22ec9ccd4e5" acquired by "delete_volume" :: waited 0.012s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:46:32 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[941d7a5d-349e-44fb-9091-df6c50ba5863]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:46:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-98ba1b90-cfa3-4607-9eb9-205e8898925c tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b46dc26a-e0a0-4fad-85c6-b22ec9ccd4e5 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:32 devstack sudo[92243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b46dc26a-e0a0-4fad-85c6-b22ec9ccd4e5 Apr 29 06:46:32 devstack sudo[92243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:33 devstack sudo[92243]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-98ba1b90-cfa3-4607-9eb9-205e8898925c tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b46dc26a-e0a0-4fad-85c6-b22ec9ccd4e5" returned: 0 in 0.747s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-98ba1b90-cfa3-4607-9eb9-205e8898925c tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b46dc26a-e0a0-4fad-85c6-b22ec9ccd4e5 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:33 devstack sudo[92254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b46dc26a-e0a0-4fad-85c6-b22ec9ccd4e5 Apr 29 06:46:33 devstack sudo[92254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:33 devstack sudo[92254]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-98ba1b90-cfa3-4607-9eb9-205e8898925c tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b46dc26a-e0a0-4fad-85c6-b22ec9ccd4e5" returned: 0 in 0.654s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:33 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-98ba1b90-cfa3-4607-9eb9-205e8898925c tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-quobyte-b46dc26a-e0a0-4fad-85c6-b22ec9ccd4e5" released by "delete_volume" :: held 1.449s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:33 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-98ba1b90-cfa3-4607-9eb9-205e8898925c tempest-CreateVolumesFromSnapshotTest-2022432072 None] Created reservations ['105ac96a-2f97-40c1-8106-e7a58e548ada', '680dbcc0-969e-452c-bd6b-bfd9b4dba8e7', '6104c963-a0b5-4802-b3e6-6e5ed952d8e6', '17efbe1b-8d81-45d8-bda1-013f901029e5'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:46:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-98ba1b90-cfa3-4607-9eb9-205e8898925c tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-98ba1b90-cfa3-4607-9eb9-205e8898925c tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-98ba1b90-cfa3-4607-9eb9-205e8898925c tempest-CreateVolumesFromSnapshotTest-2022432072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:46:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-98ba1b90-cfa3-4607-9eb9-205e8898925c tempest-CreateVolumesFromSnapshotTest-2022432072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:46:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-98ba1b90-cfa3-4607-9eb9-205e8898925c tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-98ba1b90-cfa3-4607-9eb9-205e8898925c tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:34 devstack sudo[92258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:46:34 devstack sudo[92258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:34 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-06851340-dda8-4aab-b635-ae94da5e1e77 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "cinder-d8ec9268-cda0-484f-b6dd-65b433362deb-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:46:34 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-06851340-dda8-4aab-b635-ae94da5e1e77 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-d8ec9268-cda0-484f-b6dd-65b433362deb-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:46:34 devstack sudo[92258]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:34 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-06851340-dda8-4aab-b635-ae94da5e1e77 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "cinder-quobyte-d8ec9268-cda0-484f-b6dd-65b433362deb" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:46:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-98ba1b90-cfa3-4607-9eb9-205e8898925c tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.743s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:34 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-98ba1b90-cfa3-4607-9eb9-205e8898925c tempest-CreateVolumesFromSnapshotTest-2022432072 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:46:34 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-98ba1b90-cfa3-4607-9eb9-205e8898925c tempest-CreateVolumesFromSnapshotTest-2022432072 None] Deleted volume successfully. Apr 29 06:46:34 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-06851340-dda8-4aab-b635-ae94da5e1e77 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-quobyte-d8ec9268-cda0-484f-b6dd-65b433362deb" acquired by "delete_volume" :: waited 0.033s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:46:34 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-98ba1b90-cfa3-4607-9eb9-205e8898925c tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-b46dc26a-e0a0-4fad-85c6-b22ec9ccd4e5-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:34 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2c438d-deb6-4e2d-9b52-587c6ec2d837]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:46:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-06851340-dda8-4aab-b635-ae94da5e1e77 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d8ec9268-cda0-484f-b6dd-65b433362deb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:34 devstack sudo[92263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d8ec9268-cda0-484f-b6dd-65b433362deb Apr 29 06:46:34 devstack sudo[92263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:35 devstack sudo[92263]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-06851340-dda8-4aab-b635-ae94da5e1e77 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d8ec9268-cda0-484f-b6dd-65b433362deb" returned: 0 in 0.777s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-06851340-dda8-4aab-b635-ae94da5e1e77 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d8ec9268-cda0-484f-b6dd-65b433362deb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:35 devstack sudo[92282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d8ec9268-cda0-484f-b6dd-65b433362deb Apr 29 06:46:35 devstack sudo[92282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:36 devstack sudo[92282]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-06851340-dda8-4aab-b635-ae94da5e1e77 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d8ec9268-cda0-484f-b6dd-65b433362deb" returned: 0 in 0.628s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:36 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-06851340-dda8-4aab-b635-ae94da5e1e77 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-quobyte-d8ec9268-cda0-484f-b6dd-65b433362deb" released by "delete_volume" :: held 1.455s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:36 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-06851340-dda8-4aab-b635-ae94da5e1e77 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Created reservations ['f6d546be-4094-40f8-8abd-089f4f074d84', '34c9fc36-685d-40fd-92a9-1e3b8ec9f53b', '0293f2ee-aca3-4116-b980-f99c7458eb63', 'adb798de-7f16-4072-8943-00ecadb7bab7'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:46:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-06851340-dda8-4aab-b635-ae94da5e1e77 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-06851340-dda8-4aab-b635-ae94da5e1e77 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-06851340-dda8-4aab-b635-ae94da5e1e77 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:46:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-06851340-dda8-4aab-b635-ae94da5e1e77 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:46:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-06851340-dda8-4aab-b635-ae94da5e1e77 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-06851340-dda8-4aab-b635-ae94da5e1e77 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:36 devstack sudo[92287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:46:36 devstack sudo[92287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:36 devstack cinder-volume[84195]: DEBUG oslo_service.periodic_task [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84195) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 06:46:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:46:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:46:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:36 devstack sudo[92290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:46:36 devstack sudo[92290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:36 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-853574e1-0087-4ae1-a70b-f8e20dc1eb17 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "cinder-847df34e-242d-4630-911b-6aa3b40d3f60-delete_snapshot" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:46:36 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-853574e1-0087-4ae1-a70b-f8e20dc1eb17 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-847df34e-242d-4630-911b-6aa3b40d3f60-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:46:36 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-853574e1-0087-4ae1-a70b-f8e20dc1eb17 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "cinder-quobyte-c9948517-2582-4642-b250-9b6e708033be" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:46:37 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-853574e1-0087-4ae1-a70b-f8e20dc1eb17 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-quobyte-c9948517-2582-4642-b250-9b6e708033be" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:46:37 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-853574e1-0087-4ae1-a70b-f8e20dc1eb17 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "cinder-quobyte-847df34e-242d-4630-911b-6aa3b40d3f60" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:46:37 devstack sudo[92287]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-06851340-dda8-4aab-b635-ae94da5e1e77 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.641s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:37 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-06851340-dda8-4aab-b635-ae94da5e1e77 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:46:37 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-853574e1-0087-4ae1-a70b-f8e20dc1eb17 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-quobyte-847df34e-242d-4630-911b-6aa3b40d3f60" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:46:37 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-853574e1-0087-4ae1-a70b-f8e20dc1eb17 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Deleting offline snapshot 847df34e-242d-4630-911b-6aa3b40d3f60 of volume c9948517-2582-4642-b250-9b6e708033be {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:46:37 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-853574e1-0087-4ae1-a70b-f8e20dc1eb17 tempest-CreateVolumesFromSnapshotTest-2022432072 None] snapshot_file for this snap is: volume-c9948517-2582-4642-b250-9b6e708033be.847df34e-242d-4630-911b-6aa3b40d3f60 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:46:37 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-06851340-dda8-4aab-b635-ae94da5e1e77 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Deleted volume successfully. Apr 29 06:46:37 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[24401ffe-138b-4445-8896-6263b44804b0]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:46:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-853574e1-0087-4ae1-a70b-f8e20dc1eb17 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be.847df34e-242d-4630-911b-6aa3b40d3f60 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:37 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-06851340-dda8-4aab-b635-ae94da5e1e77 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-d8ec9268-cda0-484f-b6dd-65b433362deb-delete_volume" released by "delete_volume" :: held 2.384s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:37 devstack sudo[92293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be.847df34e-242d-4630-911b-6aa3b40d3f60 Apr 29 06:46:37 devstack sudo[92293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:37 devstack sudo[92290]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.667s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:37 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:46:37 devstack sudo[92293]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-853574e1-0087-4ae1-a70b-f8e20dc1eb17 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be.847df34e-242d-4630-911b-6aa3b40d3f60" returned: 0 in 0.747s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:37 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-853574e1-0087-4ae1-a70b-f8e20dc1eb17 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9948517-2582-4642-b250-9b6e708033be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:46:37 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[996112c2-0477-4599-82fb-a7dc20d61d46]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:46:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-853574e1-0087-4ae1-a70b-f8e20dc1eb17 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:37 devstack sudo[92299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be Apr 29 06:46:37 devstack sudo[92299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:38 devstack sudo[92299]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-853574e1-0087-4ae1-a70b-f8e20dc1eb17 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be" returned: 0 in 0.728s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-853574e1-0087-4ae1-a70b-f8e20dc1eb17 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be.847df34e-242d-4630-911b-6aa3b40d3f60 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:38 devstack sudo[92307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be.847df34e-242d-4630-911b-6aa3b40d3f60 Apr 29 06:46:38 devstack sudo[92307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:39 devstack sudo[92307]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-853574e1-0087-4ae1-a70b-f8e20dc1eb17 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be.847df34e-242d-4630-911b-6aa3b40d3f60" returned: 0 in 0.688s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-853574e1-0087-4ae1-a70b-f8e20dc1eb17 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be.847df34e-242d-4630-911b-6aa3b40d3f60 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:39 devstack sudo[92312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be.847df34e-242d-4630-911b-6aa3b40d3f60 Apr 29 06:46:39 devstack sudo[92312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:39 devstack sudo[92312]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-853574e1-0087-4ae1-a70b-f8e20dc1eb17 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be.847df34e-242d-4630-911b-6aa3b40d3f60" returned: 0 in 0.640s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:39 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-853574e1-0087-4ae1-a70b-f8e20dc1eb17 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-quobyte-847df34e-242d-4630-911b-6aa3b40d3f60" released by "_delete_snapshot" :: held 2.928s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:39 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-853574e1-0087-4ae1-a70b-f8e20dc1eb17 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-quobyte-c9948517-2582-4642-b250-9b6e708033be" released by "delete_snapshot" :: held 2.958s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:40 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-853574e1-0087-4ae1-a70b-f8e20dc1eb17 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Created reservations ['3b8c3645-5c5f-408c-9f2c-67c79284d203', 'd81345d2-edfd-4a48-b840-2dcdcf678c5c', '9f861e51-a2fe-455a-b8c8-fac41e21c9ad', 'e3472c19-c072-4c9c-90a1-2e7c136c1282'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:46:40 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-853574e1-0087-4ae1-a70b-f8e20dc1eb17 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Delete snapshot completed successfully. Apr 29 06:46:40 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-853574e1-0087-4ae1-a70b-f8e20dc1eb17 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-847df34e-242d-4630-911b-6aa3b40d3f60-delete_snapshot" released by "delete_snapshot" :: held 3.091s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:40 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-b9fe7ff6-6e31-4943-85bd-0d6845be4a23 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "cinder-c9948517-2582-4642-b250-9b6e708033be-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:46:40 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-b9fe7ff6-6e31-4943-85bd-0d6845be4a23 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-c9948517-2582-4642-b250-9b6e708033be-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:46:40 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-b9fe7ff6-6e31-4943-85bd-0d6845be4a23 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "cinder-quobyte-c9948517-2582-4642-b250-9b6e708033be" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:46:40 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-b9fe7ff6-6e31-4943-85bd-0d6845be4a23 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-quobyte-c9948517-2582-4642-b250-9b6e708033be" acquired by "delete_volume" :: waited 0.037s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:46:40 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[444d3d18-352d-46eb-9176-e3e88a064c7e]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:46:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b9fe7ff6-6e31-4943-85bd-0d6845be4a23 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:40 devstack sudo[92364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be Apr 29 06:46:40 devstack sudo[92364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:41 devstack sudo[92364]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b9fe7ff6-6e31-4943-85bd-0d6845be4a23 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be" returned: 0 in 0.956s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b9fe7ff6-6e31-4943-85bd-0d6845be4a23 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:41 devstack sudo[92385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be Apr 29 06:46:41 devstack sudo[92385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:42 devstack sudo[92385]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b9fe7ff6-6e31-4943-85bd-0d6845be4a23 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c9948517-2582-4642-b250-9b6e708033be" returned: 0 in 0.654s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:42 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-b9fe7ff6-6e31-4943-85bd-0d6845be4a23 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-quobyte-c9948517-2582-4642-b250-9b6e708033be" released by "delete_volume" :: held 1.727s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:42 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-b9fe7ff6-6e31-4943-85bd-0d6845be4a23 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Created reservations ['96655546-da3f-4023-ae77-4b9d6ae54b75', 'fb8894da-c20b-463a-b70d-18f7206d7b09', 'f0c43f94-4411-44b4-bbae-c5c378b65d50', '5d1ddc6c-c483-4e08-9737-c5b8926d9dfb'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:46:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-b9fe7ff6-6e31-4943-85bd-0d6845be4a23 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-b9fe7ff6-6e31-4943-85bd-0d6845be4a23 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:42 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-b9fe7ff6-6e31-4943-85bd-0d6845be4a23 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:46:42 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-b9fe7ff6-6e31-4943-85bd-0d6845be4a23 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:46:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-b9fe7ff6-6e31-4943-85bd-0d6845be4a23 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b9fe7ff6-6e31-4943-85bd-0d6845be4a23 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:42 devstack sudo[92390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:46:42 devstack sudo[92390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:42 devstack sudo[92390]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b9fe7ff6-6e31-4943-85bd-0d6845be4a23 tempest-CreateVolumesFromSnapshotTest-2022432072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.728s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:42 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-b9fe7ff6-6e31-4943-85bd-0d6845be4a23 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:46:42 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-b9fe7ff6-6e31-4943-85bd-0d6845be4a23 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Deleted volume successfully. Apr 29 06:46:42 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-b9fe7ff6-6e31-4943-85bd-0d6845be4a23 tempest-CreateVolumesFromSnapshotTest-2022432072 None] Lock "cinder-c9948517-2582-4642-b250-9b6e708033be-delete_volume" released by "delete_volume" :: held 2.717s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:43 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-cc732b79-7f3f-46f2-89cf-b5e46d446cd8 tempest-VolumesActionsTest-1468389369 None] Acquiring lock "cinder-be0a4244-7e80-4b88-abef-1ddd66fb470b" by "attach_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:46:43 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-cc732b79-7f3f-46f2-89cf-b5e46d446cd8 tempest-VolumesActionsTest-1468389369 None] Lock "cinder-be0a4244-7e80-4b88-abef-1ddd66fb470b" acquired by "attach_volume" :: waited 0.034s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:46:43 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-cc732b79-7f3f-46f2-89cf-b5e46d446cd8 tempest-VolumesActionsTest-1468389369 None] Attaching volume be0a4244-7e80-4b88-abef-1ddd66fb470b to instance 7db53a82-a9b1-4aea-afb7-e4f0cfa21dde at mountpoint /dev/vdb on host None. Apr 29 06:46:43 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-cc732b79-7f3f-46f2-89cf-b5e46d446cd8 tempest-VolumesActionsTest-1468389369 None] Attach volume completed successfully. Apr 29 06:46:43 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-cc732b79-7f3f-46f2-89cf-b5e46d446cd8 tempest-VolumesActionsTest-1468389369 None] Lock "cinder-be0a4244-7e80-4b88-abef-1ddd66fb470b" released by "attach_volume" :: held 0.120s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:44 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-334bd698-b42f-4c13-a65c-90b3c6f65de8 tempest-VolumesActionsTest-1468389369 None] Acquiring lock "cinder-be0a4244-7e80-4b88-abef-1ddd66fb470b-detach_volume" by "detach_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:46:44 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-334bd698-b42f-4c13-a65c-90b3c6f65de8 tempest-VolumesActionsTest-1468389369 None] Lock "cinder-be0a4244-7e80-4b88-abef-1ddd66fb470b-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:46:44 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-334bd698-b42f-4c13-a65c-90b3c6f65de8 tempest-VolumesActionsTest-1468389369 None] Detaching volume be0a4244-7e80-4b88-abef-1ddd66fb470b from instance 7db53a82-a9b1-4aea-afb7-e4f0cfa21dde. Apr 29 06:46:44 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-334bd698-b42f-4c13-a65c-90b3c6f65de8 tempest-VolumesActionsTest-1468389369 None] Detach volume completed successfully. Apr 29 06:46:44 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-334bd698-b42f-4c13-a65c-90b3c6f65de8 tempest-VolumesActionsTest-1468389369 None] Lock "cinder-be0a4244-7e80-4b88-abef-1ddd66fb470b-detach_volume" released by "detach_volume" :: held 0.059s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:45 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:46:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Flow 'volume_create_manager' (75565c82-0f4f-477b-8fc2-8b4714e26b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:46:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b5f0872-8456-4438-b4c0-b6624a137034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b5f0872-8456-4438-b4c0-b6624a137034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9746ad0-30a3-46a5-83e2-0e48e6da6bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f47b13b8d1ce4fb8b200fd76126ca384',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:46:45Z,use_quota=True,user_id='6a4cb80b32ac489aa5c4e6658325c692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a865c53-c526-42bd-9535-68e9d78c7f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a865c53-c526-42bd-9535-68e9d78c7f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4ce8bc7-0f59-407a-9641-50818114fd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4ce8bc7-0f59-407a-9641-50818114fd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9746ad0-30a3-46a5-83e2-0e48e6da6bf4', 'volume_name': 'volume-e9746ad0-30a3-46a5-83e2-0e48e6da6bf4', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b02b3b-66df-4162-aa33-9b7b1b67d764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b02b3b-66df-4162-aa33-9b7b1b67d764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55dcbe6a-7acf-48fd-a383-62f86b6350ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:45 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Volume e9746ad0-30a3-46a5-83e2-0e48e6da6bf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9746ad0-30a3-46a5-83e2-0e48e6da6bf4', 'volume_size': 1} Apr 29 06:46:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:45 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9746ad0-30a3-46a5-83e2-0e48e6da6bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f47b13b8d1ce4fb8b200fd76126ca384',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:46:45Z,use_quota=True,user_id='6a4cb80b32ac489aa5c4e6658325c692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:46:45 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Creating volume e9746ad0-30a3-46a5-83e2-0e48e6da6bf4 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:46:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:45 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:46:45 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:46:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:45 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:46:45 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:46:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e9746ad0-30a3-46a5-83e2-0e48e6da6bf4 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:45 devstack sudo[92394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e9746ad0-30a3-46a5-83e2-0e48e6da6bf4 1073741824 Apr 29 06:46:45 devstack sudo[92394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:46 devstack sudo[92394]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e9746ad0-30a3-46a5-83e2-0e48e6da6bf4 1073741824" returned: 0 in 0.915s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e9746ad0-30a3-46a5-83e2-0e48e6da6bf4 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:46 devstack sudo[92442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e9746ad0-30a3-46a5-83e2-0e48e6da6bf4 Apr 29 06:46:46 devstack sudo[92442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:47 devstack sudo[92442]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e9746ad0-30a3-46a5-83e2-0e48e6da6bf4" returned: 0 in 0.650s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:46:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55dcbe6a-7acf-48fd-a383-62f86b6350ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9746ad0-30a3-46a5-83e2-0e48e6da6bf4', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2f2958-267b-42c3-b077-203b300e05f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:47 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Volume volume-e9746ad0-30a3-46a5-83e2-0e48e6da6bf4 (e9746ad0-30a3-46a5-83e2-0e48e6da6bf4): created successfully Apr 29 06:46:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2f2958-267b-42c3-b077-203b300e05f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Flow 'volume_create_manager' (75565c82-0f4f-477b-8fc2-8b4714e26b8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:46:47 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-bda78e08-6418-4e71-ae0f-298abb849e53 tempest-CinderUnicodeTest-1648480274 None] Created volume successfully. Apr 29 06:46:48 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:46:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Flow 'volume_create_manager' (a8bb87f2-fe78-49ff-ba79-b2149bf9667d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:46:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4774db4-9514-46dd-8f73-19ed44f6acb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4774db4-9514-46dd-8f73-19ed44f6acb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:46:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1899612133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76464eaa-1edf-4a9e-a17d-f575f61f80da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f47b13b8d1ce4fb8b200fd76126ca384',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:46:48Z,use_quota=True,user_id='6a4cb80b32ac489aa5c4e6658325c692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c61eff0e-ca56-4ec2-95c5-501715075ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c61eff0e-ca56-4ec2-95c5-501715075ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41eefcc3-3ca8-4807-82a2-56e8a307334f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41eefcc3-3ca8-4807-82a2-56e8a307334f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76464eaa-1edf-4a9e-a17d-f575f61f80da', 'volume_name': 'volume-76464eaa-1edf-4a9e-a17d-f575f61f80da', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8e86c6-efe3-49b8-8bf2-be7f3516f376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8e86c6-efe3-49b8-8bf2-be7f3516f376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b07ec2c-0040-43af-b897-e1f0a380ac2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:48 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Volume 76464eaa-1edf-4a9e-a17d-f575f61f80da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76464eaa-1edf-4a9e-a17d-f575f61f80da', 'volume_size': 1} Apr 29 06:46:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:48 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:46:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1899612133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76464eaa-1edf-4a9e-a17d-f575f61f80da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f47b13b8d1ce4fb8b200fd76126ca384',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:46:48Z,use_quota=True,user_id='6a4cb80b32ac489aa5c4e6658325c692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:46:48 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Creating volume 76464eaa-1edf-4a9e-a17d-f575f61f80da {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:46:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:48 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:46:48 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:46:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:48 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:46:48 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:46:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:48 devstack sudo[92448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da 1073741824 Apr 29 06:46:48 devstack sudo[92448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:49 devstack sudo[92448]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da 1073741824" returned: 0 in 0.765s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:49 devstack sudo[92453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da Apr 29 06:46:49 devstack sudo[92453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:49 devstack sudo[92453]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da" returned: 0 in 0.627s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:46:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b07ec2c-0040-43af-b897-e1f0a380ac2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76464eaa-1edf-4a9e-a17d-f575f61f80da', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f04cf7ee-d025-4482-8a0f-48258df0d14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:46:49 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Volume volume-76464eaa-1edf-4a9e-a17d-f575f61f80da (76464eaa-1edf-4a9e-a17d-f575f61f80da): created successfully Apr 29 06:46:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f04cf7ee-d025-4482-8a0f-48258df0d14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:46:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Flow 'volume_create_manager' (a8bb87f2-fe78-49ff-ba79-b2149bf9667d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:46:49 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-51cea3d5-dafe-40f2-a788-77b90d40c06e tempest-CinderUnicodeTest-1648480274 None] Created volume successfully. Apr 29 06:46:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1c60ba58-59ff-4a00-8e91-27474af9d09a tempest-CinderUnicodeTest-1648480274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:46:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1c60ba58-59ff-4a00-8e91-27474af9d09a tempest-CinderUnicodeTest-1648480274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:46:50 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-1c60ba58-59ff-4a00-8e91-27474af9d09a tempest-CinderUnicodeTest-1648480274 None] Creating offline snapshot 9fc2d6e4-71ed-49e5-858e-db8e49360bb7 of volume 76464eaa-1edf-4a9e-a17d-f575f61f80da {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:46:50 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ef380b-874c-4042-9149-002d3e7a9f81]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:46:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1c60ba58-59ff-4a00-8e91-27474af9d09a tempest-CinderUnicodeTest-1648480274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:50 devstack sudo[92456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da Apr 29 06:46:50 devstack sudo[92456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:51 devstack sudo[92456]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1c60ba58-59ff-4a00-8e91-27474af9d09a tempest-CinderUnicodeTest-1648480274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da" returned: 0 in 0.694s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1c60ba58-59ff-4a00-8e91-27474af9d09a tempest-CinderUnicodeTest-1648480274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da.9fc2d6e4-71ed-49e5-858e-db8e49360bb7 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:51 devstack sudo[92461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da.9fc2d6e4-71ed-49e5-858e-db8e49360bb7 1G Apr 29 06:46:51 devstack sudo[92461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:52 devstack sudo[92461]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1c60ba58-59ff-4a00-8e91-27474af9d09a tempest-CinderUnicodeTest-1648480274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da.9fc2d6e4-71ed-49e5-858e-db8e49360bb7 1G" returned: 0 in 0.783s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1c60ba58-59ff-4a00-8e91-27474af9d09a tempest-CinderUnicodeTest-1648480274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76464eaa-1edf-4a9e-a17d-f575f61f80da -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da.9fc2d6e4-71ed-49e5-858e-db8e49360bb7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:52 devstack sudo[92466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76464eaa-1edf-4a9e-a17d-f575f61f80da -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da.9fc2d6e4-71ed-49e5-858e-db8e49360bb7 Apr 29 06:46:52 devstack sudo[92466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:52 devstack sudo[92466]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1c60ba58-59ff-4a00-8e91-27474af9d09a tempest-CinderUnicodeTest-1648480274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76464eaa-1edf-4a9e-a17d-f575f61f80da -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da.9fc2d6e4-71ed-49e5-858e-db8e49360bb7" returned: 0 in 0.659s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:52 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-1c60ba58-59ff-4a00-8e91-27474af9d09a tempest-CinderUnicodeTest-1648480274 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da.9fc2d6e4-71ed-49e5-858e-db8e49360bb7 is being set with open permissions: ugo+rw Apr 29 06:46:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1c60ba58-59ff-4a00-8e91-27474af9d09a tempest-CinderUnicodeTest-1648480274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da.9fc2d6e4-71ed-49e5-858e-db8e49360bb7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:52 devstack sudo[92471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da.9fc2d6e4-71ed-49e5-858e-db8e49360bb7 Apr 29 06:46:52 devstack sudo[92471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:53 devstack sudo[92471]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1c60ba58-59ff-4a00-8e91-27474af9d09a tempest-CinderUnicodeTest-1648480274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da.9fc2d6e4-71ed-49e5-858e-db8e49360bb7" returned: 0 in 0.630s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1c60ba58-59ff-4a00-8e91-27474af9d09a tempest-CinderUnicodeTest-1648480274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:53 devstack sudo[92477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da.info Apr 29 06:46:53 devstack sudo[92477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:54 devstack sudo[92477]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1c60ba58-59ff-4a00-8e91-27474af9d09a tempest-CinderUnicodeTest-1648480274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da.info" returned: 0 in 0.655s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:54 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-1c60ba58-59ff-4a00-8e91-27474af9d09a tempest-CinderUnicodeTest-1648480274 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da.info is being set with open permissions: ugo+rw Apr 29 06:46:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1c60ba58-59ff-4a00-8e91-27474af9d09a tempest-CinderUnicodeTest-1648480274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:54 devstack sudo[92480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da.info Apr 29 06:46:54 devstack sudo[92480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:54 devstack sudo[92480]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1c60ba58-59ff-4a00-8e91-27474af9d09a tempest-CinderUnicodeTest-1648480274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da.info" returned: 0 in 0.619s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1c60ba58-59ff-4a00-8e91-27474af9d09a tempest-CinderUnicodeTest-1648480274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.146s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:46:54 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-1c60ba58-59ff-4a00-8e91-27474af9d09a tempest-CinderUnicodeTest-1648480274 None] Create snapshot completed successfully Apr 29 06:46:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-32e62b6e-66f0-4b92-98d9-1c4580013cda tempest-CinderUnicodeTest-1648480274 None] Acquiring lock "cinder-9fc2d6e4-71ed-49e5-858e-db8e49360bb7-delete_snapshot" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:46:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-32e62b6e-66f0-4b92-98d9-1c4580013cda tempest-CinderUnicodeTest-1648480274 None] Lock "cinder-9fc2d6e4-71ed-49e5-858e-db8e49360bb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:46:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-32e62b6e-66f0-4b92-98d9-1c4580013cda tempest-CinderUnicodeTest-1648480274 None] Acquiring lock "cinder-quobyte-76464eaa-1edf-4a9e-a17d-f575f61f80da" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:46:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-32e62b6e-66f0-4b92-98d9-1c4580013cda tempest-CinderUnicodeTest-1648480274 None] Lock "cinder-quobyte-76464eaa-1edf-4a9e-a17d-f575f61f80da" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:46:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-32e62b6e-66f0-4b92-98d9-1c4580013cda tempest-CinderUnicodeTest-1648480274 None] Acquiring lock "cinder-quobyte-9fc2d6e4-71ed-49e5-858e-db8e49360bb7" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:46:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-32e62b6e-66f0-4b92-98d9-1c4580013cda tempest-CinderUnicodeTest-1648480274 None] Lock "cinder-quobyte-9fc2d6e4-71ed-49e5-858e-db8e49360bb7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:46:55 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-32e62b6e-66f0-4b92-98d9-1c4580013cda tempest-CinderUnicodeTest-1648480274 None] Deleting offline snapshot 9fc2d6e4-71ed-49e5-858e-db8e49360bb7 of volume 76464eaa-1edf-4a9e-a17d-f575f61f80da {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:46:55 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-32e62b6e-66f0-4b92-98d9-1c4580013cda tempest-CinderUnicodeTest-1648480274 None] snapshot_file for this snap is: volume-76464eaa-1edf-4a9e-a17d-f575f61f80da.9fc2d6e4-71ed-49e5-858e-db8e49360bb7 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:46:55 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfc1436-faf1-4e75-8779-9a6707d0dcbe]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:46:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-32e62b6e-66f0-4b92-98d9-1c4580013cda tempest-CinderUnicodeTest-1648480274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da.9fc2d6e4-71ed-49e5-858e-db8e49360bb7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:56 devstack sudo[92484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da.9fc2d6e4-71ed-49e5-858e-db8e49360bb7 Apr 29 06:46:56 devstack sudo[92484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:56 devstack sudo[92484]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-32e62b6e-66f0-4b92-98d9-1c4580013cda tempest-CinderUnicodeTest-1648480274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da.9fc2d6e4-71ed-49e5-858e-db8e49360bb7" returned: 0 in 0.685s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-32e62b6e-66f0-4b92-98d9-1c4580013cda tempest-CinderUnicodeTest-1648480274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76464eaa-1edf-4a9e-a17d-f575f61f80da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:46:56 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[23841fff-9653-4caa-8ceb-099cc8911187]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:46:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-32e62b6e-66f0-4b92-98d9-1c4580013cda tempest-CinderUnicodeTest-1648480274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:56 devstack sudo[92490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da Apr 29 06:46:56 devstack sudo[92490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:57 devstack sudo[92490]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-32e62b6e-66f0-4b92-98d9-1c4580013cda tempest-CinderUnicodeTest-1648480274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da" returned: 0 in 0.742s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-32e62b6e-66f0-4b92-98d9-1c4580013cda tempest-CinderUnicodeTest-1648480274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da.9fc2d6e4-71ed-49e5-858e-db8e49360bb7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:57 devstack sudo[92495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da.9fc2d6e4-71ed-49e5-858e-db8e49360bb7 Apr 29 06:46:57 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:58 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-32e62b6e-66f0-4b92-98d9-1c4580013cda tempest-CinderUnicodeTest-1648480274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da.9fc2d6e4-71ed-49e5-858e-db8e49360bb7" returned: 0 in 0.779s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-32e62b6e-66f0-4b92-98d9-1c4580013cda tempest-CinderUnicodeTest-1648480274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da.9fc2d6e4-71ed-49e5-858e-db8e49360bb7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:46:58 devstack sudo[92502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da.9fc2d6e4-71ed-49e5-858e-db8e49360bb7 Apr 29 06:46:58 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:46:58 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root Apr 29 06:46:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-32e62b6e-66f0-4b92-98d9-1c4580013cda tempest-CinderUnicodeTest-1648480274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da.9fc2d6e4-71ed-49e5-858e-db8e49360bb7" returned: 0 in 0.703s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:46:58 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-32e62b6e-66f0-4b92-98d9-1c4580013cda tempest-CinderUnicodeTest-1648480274 None] Lock "cinder-quobyte-9fc2d6e4-71ed-49e5-858e-db8e49360bb7" released by "_delete_snapshot" :: held 3.031s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:58 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-32e62b6e-66f0-4b92-98d9-1c4580013cda tempest-CinderUnicodeTest-1648480274 None] Lock "cinder-quobyte-76464eaa-1edf-4a9e-a17d-f575f61f80da" released by "delete_snapshot" :: held 3.058s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:46:59 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-32e62b6e-66f0-4b92-98d9-1c4580013cda tempest-CinderUnicodeTest-1648480274 None] Created reservations ['bfd06f1f-4439-4797-92b6-9177c32a745f', 'a3fe816d-952b-4c2e-a9e9-26b7a332c128', '4645b3e1-2ba7-441e-b457-31b49adddd88', 'd81eaf3c-74e9-4333-914b-8b9f1b44c2a7'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:46:59 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-32e62b6e-66f0-4b92-98d9-1c4580013cda tempest-CinderUnicodeTest-1648480274 None] Delete snapshot completed successfully. Apr 29 06:46:59 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-32e62b6e-66f0-4b92-98d9-1c4580013cda tempest-CinderUnicodeTest-1648480274 None] Lock "cinder-9fc2d6e4-71ed-49e5-858e-db8e49360bb7-delete_snapshot" released by "delete_snapshot" :: held 3.269s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:47:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-98e62746-f6a6-418d-8ccf-e4b33e0df9d7 tempest-CinderUnicodeTest-1648480274 None] Acquiring lock "cinder-76464eaa-1edf-4a9e-a17d-f575f61f80da-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:47:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-98e62746-f6a6-418d-8ccf-e4b33e0df9d7 tempest-CinderUnicodeTest-1648480274 None] Lock "cinder-76464eaa-1edf-4a9e-a17d-f575f61f80da-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:47:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-98e62746-f6a6-418d-8ccf-e4b33e0df9d7 tempest-CinderUnicodeTest-1648480274 None] Acquiring lock "cinder-quobyte-76464eaa-1edf-4a9e-a17d-f575f61f80da" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:47:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-98e62746-f6a6-418d-8ccf-e4b33e0df9d7 tempest-CinderUnicodeTest-1648480274 None] Lock "cinder-quobyte-76464eaa-1edf-4a9e-a17d-f575f61f80da" acquired by "delete_volume" :: waited 0.016s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:47:00 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5e7045-d59a-47dc-bb92-b733cac2919e]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:47:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-98e62746-f6a6-418d-8ccf-e4b33e0df9d7 tempest-CinderUnicodeTest-1648480274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:47:00 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da Apr 29 06:47:00 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:47:00 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Apr 29 06:47:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-98e62746-f6a6-418d-8ccf-e4b33e0df9d7 tempest-CinderUnicodeTest-1648480274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da" returned: 0 in 0.736s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:47:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-98e62746-f6a6-418d-8ccf-e4b33e0df9d7 tempest-CinderUnicodeTest-1648480274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:47:00 devstack sudo[92526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da Apr 29 06:47:00 devstack sudo[92526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:47:01 devstack sudo[92526]: pam_unix(sudo:session): session closed for user root Apr 29 06:47:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-98e62746-f6a6-418d-8ccf-e4b33e0df9d7 tempest-CinderUnicodeTest-1648480274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-76464eaa-1edf-4a9e-a17d-f575f61f80da" returned: 0 in 0.590s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:47:01 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-98e62746-f6a6-418d-8ccf-e4b33e0df9d7 tempest-CinderUnicodeTest-1648480274 None] Lock "cinder-quobyte-76464eaa-1edf-4a9e-a17d-f575f61f80da" released by "delete_volume" :: held 1.395s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:47:01 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-98e62746-f6a6-418d-8ccf-e4b33e0df9d7 tempest-CinderUnicodeTest-1648480274 None] Created reservations ['62e66bd8-3445-42d5-921e-b71b6eeae5d6', '43998ea8-f1aa-42b9-a616-cf30cfcc1d60', '71c2cf62-70ef-46f5-bfad-ad3887aca3e5', 'ccc6e036-cf5c-45c8-af8b-d9cb0f20a728'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:47:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-98e62746-f6a6-418d-8ccf-e4b33e0df9d7 tempest-CinderUnicodeTest-1648480274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:47:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-98e62746-f6a6-418d-8ccf-e4b33e0df9d7 tempest-CinderUnicodeTest-1648480274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:47:01 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-98e62746-f6a6-418d-8ccf-e4b33e0df9d7 tempest-CinderUnicodeTest-1648480274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:47:01 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-98e62746-f6a6-418d-8ccf-e4b33e0df9d7 tempest-CinderUnicodeTest-1648480274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:47:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-98e62746-f6a6-418d-8ccf-e4b33e0df9d7 tempest-CinderUnicodeTest-1648480274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:47:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-98e62746-f6a6-418d-8ccf-e4b33e0df9d7 tempest-CinderUnicodeTest-1648480274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:47:01 devstack sudo[92529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:47:01 devstack sudo[92529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:47:02 devstack sudo[92529]: pam_unix(sudo:session): session closed for user root Apr 29 06:47:02 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-27922df2-4b92-451f-9373-4ecc127a9e06 tempest-CinderUnicodeTest-1648480274 None] Acquiring lock "cinder-e9746ad0-30a3-46a5-83e2-0e48e6da6bf4-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:47:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-98e62746-f6a6-418d-8ccf-e4b33e0df9d7 tempest-CinderUnicodeTest-1648480274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.643s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:47:02 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-98e62746-f6a6-418d-8ccf-e4b33e0df9d7 tempest-CinderUnicodeTest-1648480274 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:47:02 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-98e62746-f6a6-418d-8ccf-e4b33e0df9d7 tempest-CinderUnicodeTest-1648480274 None] Deleted volume successfully. Apr 29 06:47:02 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-27922df2-4b92-451f-9373-4ecc127a9e06 tempest-CinderUnicodeTest-1648480274 None] Lock "cinder-e9746ad0-30a3-46a5-83e2-0e48e6da6bf4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:47:02 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-98e62746-f6a6-418d-8ccf-e4b33e0df9d7 tempest-CinderUnicodeTest-1648480274 None] Lock "cinder-76464eaa-1edf-4a9e-a17d-f575f61f80da-delete_volume" released by "delete_volume" :: held 2.244s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:47:02 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-27922df2-4b92-451f-9373-4ecc127a9e06 tempest-CinderUnicodeTest-1648480274 None] Acquiring lock "cinder-quobyte-e9746ad0-30a3-46a5-83e2-0e48e6da6bf4" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:47:02 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-27922df2-4b92-451f-9373-4ecc127a9e06 tempest-CinderUnicodeTest-1648480274 None] Lock "cinder-quobyte-e9746ad0-30a3-46a5-83e2-0e48e6da6bf4" acquired by "delete_volume" :: waited 0.014s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:47:02 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c88a2e-0b10-43fd-b496-cf8466db937f]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:47:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-27922df2-4b92-451f-9373-4ecc127a9e06 tempest-CinderUnicodeTest-1648480274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e9746ad0-30a3-46a5-83e2-0e48e6da6bf4 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:47:02 devstack sudo[92532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e9746ad0-30a3-46a5-83e2-0e48e6da6bf4 Apr 29 06:47:02 devstack sudo[92532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:47:03 devstack sudo[92532]: pam_unix(sudo:session): session closed for user root Apr 29 06:47:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-27922df2-4b92-451f-9373-4ecc127a9e06 tempest-CinderUnicodeTest-1648480274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e9746ad0-30a3-46a5-83e2-0e48e6da6bf4" returned: 0 in 0.743s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:47:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-27922df2-4b92-451f-9373-4ecc127a9e06 tempest-CinderUnicodeTest-1648480274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e9746ad0-30a3-46a5-83e2-0e48e6da6bf4 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:47:03 devstack sudo[92541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e9746ad0-30a3-46a5-83e2-0e48e6da6bf4 Apr 29 06:47:03 devstack sudo[92541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:47:03 devstack sudo[92541]: pam_unix(sudo:session): session closed for user root Apr 29 06:47:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-27922df2-4b92-451f-9373-4ecc127a9e06 tempest-CinderUnicodeTest-1648480274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e9746ad0-30a3-46a5-83e2-0e48e6da6bf4" returned: 0 in 0.637s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:47:03 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-27922df2-4b92-451f-9373-4ecc127a9e06 tempest-CinderUnicodeTest-1648480274 None] Lock "cinder-quobyte-e9746ad0-30a3-46a5-83e2-0e48e6da6bf4" released by "delete_volume" :: held 1.420s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:47:03 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-27922df2-4b92-451f-9373-4ecc127a9e06 tempest-CinderUnicodeTest-1648480274 None] Created reservations ['ad0bf352-b606-4390-af0b-0eb6d385c59b', '966caee8-2e3c-4040-8efa-61c2adaa7410', 'cfa96b59-8887-47fe-8297-42958bd51d91', '6b521513-2b97-410d-ae17-6a9fa6774f6e'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:47:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-27922df2-4b92-451f-9373-4ecc127a9e06 tempest-CinderUnicodeTest-1648480274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:47:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-27922df2-4b92-451f-9373-4ecc127a9e06 tempest-CinderUnicodeTest-1648480274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:47:03 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-27922df2-4b92-451f-9373-4ecc127a9e06 tempest-CinderUnicodeTest-1648480274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:47:03 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-27922df2-4b92-451f-9373-4ecc127a9e06 tempest-CinderUnicodeTest-1648480274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:47:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-27922df2-4b92-451f-9373-4ecc127a9e06 tempest-CinderUnicodeTest-1648480274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:47:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-27922df2-4b92-451f-9373-4ecc127a9e06 tempest-CinderUnicodeTest-1648480274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:47:03 devstack sudo[92544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:47:03 devstack sudo[92544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:47:04 devstack sudo[92544]: pam_unix(sudo:session): session closed for user root Apr 29 06:47:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-27922df2-4b92-451f-9373-4ecc127a9e06 tempest-CinderUnicodeTest-1648480274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.621s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:47:04 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-27922df2-4b92-451f-9373-4ecc127a9e06 tempest-CinderUnicodeTest-1648480274 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:47:04 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-27922df2-4b92-451f-9373-4ecc127a9e06 tempest-CinderUnicodeTest-1648480274 None] Deleted volume successfully. Apr 29 06:47:04 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-27922df2-4b92-451f-9373-4ecc127a9e06 tempest-CinderUnicodeTest-1648480274 None] Lock "cinder-e9746ad0-30a3-46a5-83e2-0e48e6da6bf4-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:47:08 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-32c1abe1-aade-40e4-80d3-00f11d599214 tempest-VolumesActionsTest-1468389369 None] Acquiring lock "cinder-be0a4244-7e80-4b88-abef-1ddd66fb470b" by "attach_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:47:08 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-32c1abe1-aade-40e4-80d3-00f11d599214 tempest-VolumesActionsTest-1468389369 None] Lock "cinder-be0a4244-7e80-4b88-abef-1ddd66fb470b" acquired by "attach_volume" :: waited 0.023s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:47:08 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-32c1abe1-aade-40e4-80d3-00f11d599214 tempest-VolumesActionsTest-1468389369 None] Attaching volume be0a4244-7e80-4b88-abef-1ddd66fb470b to instance fe5b2f2e-fead-401d-b486-152c13c83b64 at mountpoint /dev/vdb on host None. Apr 29 06:47:08 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-32c1abe1-aade-40e4-80d3-00f11d599214 tempest-VolumesActionsTest-1468389369 None] Attach volume completed successfully. Apr 29 06:47:08 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-32c1abe1-aade-40e4-80d3-00f11d599214 tempest-VolumesActionsTest-1468389369 None] Lock "cinder-be0a4244-7e80-4b88-abef-1ddd66fb470b" released by "attach_volume" :: held 0.085s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:47:09 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ab31a817-0428-4198-8176-c3ad560847f0 tempest-VolumesActionsTest-1468389369 None] Acquiring lock "cinder-be0a4244-7e80-4b88-abef-1ddd66fb470b-detach_volume" by "detach_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:47:09 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ab31a817-0428-4198-8176-c3ad560847f0 tempest-VolumesActionsTest-1468389369 None] Lock "cinder-be0a4244-7e80-4b88-abef-1ddd66fb470b-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:47:09 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-ab31a817-0428-4198-8176-c3ad560847f0 tempest-VolumesActionsTest-1468389369 None] Detaching volume be0a4244-7e80-4b88-abef-1ddd66fb470b from instance fe5b2f2e-fead-401d-b486-152c13c83b64. Apr 29 06:47:09 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-ab31a817-0428-4198-8176-c3ad560847f0 tempest-VolumesActionsTest-1468389369 None] Detach volume completed successfully. Apr 29 06:47:09 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ab31a817-0428-4198-8176-c3ad560847f0 tempest-VolumesActionsTest-1468389369 None] Lock "cinder-be0a4244-7e80-4b88-abef-1ddd66fb470b-detach_volume" released by "detach_volume" :: held 0.060s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:47:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3426c095-3bfc-4df7-b9fd-d180b499a01c tempest-VolumesActionsTest-1468389369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:47:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3426c095-3bfc-4df7-b9fd-d180b499a01c tempest-VolumesActionsTest-1468389369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:47:17 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[834f5d3d-e9c7-41f6-a52d-6cfc9dee9007]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:47:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3426c095-3bfc-4df7-b9fd-d180b499a01c tempest-VolumesActionsTest-1468389369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:47:17 devstack sudo[92661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b Apr 29 06:47:17 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:47:18 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root Apr 29 06:47:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3426c095-3bfc-4df7-b9fd-d180b499a01c tempest-VolumesActionsTest-1468389369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b" returned: 0 in 0.725s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:47:18 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb37272-8f0c-4b4b-a569-8a80aa0a0956]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:47:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3426c095-3bfc-4df7-b9fd-d180b499a01c tempest-VolumesActionsTest-1468389369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:47:18 devstack sudo[92666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b Apr 29 06:47:18 devstack sudo[92666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:47:18 devstack sudo[92666]: pam_unix(sudo:session): session closed for user root Apr 29 06:47:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3426c095-3bfc-4df7-b9fd-d180b499a01c tempest-VolumesActionsTest-1468389369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b" returned: 0 in 0.724s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:47:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3426c095-3bfc-4df7-b9fd-d180b499a01c tempest-VolumesActionsTest-1468389369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b /opt/stack/data/cinder/conversion/be0a4244-7e80-4b88-abef-1ddd66fb470b.temp_image.bc8c0ce0-2c5d-4592-a200-e0d376e4379b8dv0s06_.img {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:47:18 devstack sudo[92671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b /opt/stack/data/cinder/conversion/be0a4244-7e80-4b88-abef-1ddd66fb470b.temp_image.bc8c0ce0-2c5d-4592-a200-e0d376e4379b8dv0s06_.img Apr 29 06:47:18 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:47:23 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root Apr 29 06:47:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3426c095-3bfc-4df7-b9fd-d180b499a01c tempest-VolumesActionsTest-1468389369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b /opt/stack/data/cinder/conversion/be0a4244-7e80-4b88-abef-1ddd66fb470b.temp_image.bc8c0ce0-2c5d-4592-a200-e0d376e4379b8dv0s06_.img" returned: 0 in 4.335s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:47:23 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[d092e1fb-e1fc-4c3c-8428-ff8b2159ce0b]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:47:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3426c095-3bfc-4df7-b9fd-d180b499a01c tempest-VolumesActionsTest-1468389369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:47:23 devstack sudo[92686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b Apr 29 06:47:23 devstack sudo[92686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:47:24 devstack sudo[92686]: pam_unix(sudo:session): session closed for user root Apr 29 06:47:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3426c095-3bfc-4df7-b9fd-d180b499a01c tempest-VolumesActionsTest-1468389369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b" returned: 0 in 0.854s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:47:24 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-3426c095-3bfc-4df7-b9fd-d180b499a01c tempest-VolumesActionsTest-1468389369 None] Image conversion details: src /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b, size 1024.00 MB, duration 4.34 sec, destination /opt/stack/data/cinder/conversion/be0a4244-7e80-4b88-abef-1ddd66fb470b.temp_image.bc8c0ce0-2c5d-4592-a200-e0d376e4379b8dv0s06_.img {{(pid=84195) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 06:47:24 devstack cinder-volume[84195]: INFO cinder.image.image_utils [None req-3426c095-3bfc-4df7-b9fd-d180b499a01c tempest-VolumesActionsTest-1468389369 None] Converted 1024.00 MB image at 236.15 MB/s Apr 29 06:47:24 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:SELECT=82,cinder:UPDATE=108,cinder:DELETE=6,cinder:INSERT=28 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:47:24 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:UPDATE=100,cinder:DELETE=11,cinder:SELECT=79,cinder:INSERT=24 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:47:24 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-3426c095-3bfc-4df7-b9fd-d180b499a01c tempest-VolumesActionsTest-1468389369 None] bc8c0ce0-2c5d-4592-a200-e0d376e4379b was raw, no need to convert to raw {{(pid=84195) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 29 06:47:36 devstack cinder-volume[84195]: DEBUG oslo_service.periodic_task [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84195) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 06:47:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:47:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:47:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:47:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:47:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:47:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:47:36 devstack sudo[92738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:47:36 devstack sudo[92738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:47:37 devstack sudo[92738]: pam_unix(sudo:session): session closed for user root Apr 29 06:47:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.719s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:47:37 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:47:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3426c095-3bfc-4df7-b9fd-d180b499a01c tempest-VolumesActionsTest-1468389369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.186s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:47:42 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-3426c095-3bfc-4df7-b9fd-d180b499a01c tempest-VolumesActionsTest-1468389369 None] Uploaded volume to glance image-id: bc8c0ce0-2c5d-4592-a200-e0d376e4379b. {{(pid=84195) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 29 06:47:42 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-3426c095-3bfc-4df7-b9fd-d180b499a01c tempest-VolumesActionsTest-1468389369 None] Copy volume to image completed successfully. Apr 29 06:47:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c536c0f4-7ee7-4191-9910-c40278e5c5d8 tempest-VolumesActionsTest-1468389369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:47:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c536c0f4-7ee7-4191-9910-c40278e5c5d8 tempest-VolumesActionsTest-1468389369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:47:44 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c74df3-0701-46fd-93b0-0d2e8cc5e594]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:47:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c536c0f4-7ee7-4191-9910-c40278e5c5d8 tempest-VolumesActionsTest-1468389369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:47:44 devstack sudo[92741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b Apr 29 06:47:44 devstack sudo[92741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:47:44 devstack sudo[92741]: pam_unix(sudo:session): session closed for user root Apr 29 06:47:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c536c0f4-7ee7-4191-9910-c40278e5c5d8 tempest-VolumesActionsTest-1468389369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b" returned: 0 in 0.687s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:47:44 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee4b877-fae0-4d9f-a832-c3850b05524b]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:47:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c536c0f4-7ee7-4191-9910-c40278e5c5d8 tempest-VolumesActionsTest-1468389369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:47:44 devstack sudo[92746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b Apr 29 06:47:44 devstack sudo[92746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:47:45 devstack sudo[92746]: pam_unix(sudo:session): session closed for user root Apr 29 06:47:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c536c0f4-7ee7-4191-9910-c40278e5c5d8 tempest-VolumesActionsTest-1468389369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b" returned: 0 in 0.691s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:47:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c536c0f4-7ee7-4191-9910-c40278e5c5d8 tempest-VolumesActionsTest-1468389369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b /opt/stack/data/cinder/conversion/be0a4244-7e80-4b88-abef-1ddd66fb470b.temp_image.cfdd8b44-81ad-4f40-a3e2-8ef1412b8752gja_ttjo.img {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:47:45 devstack sudo[92751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b /opt/stack/data/cinder/conversion/be0a4244-7e80-4b88-abef-1ddd66fb470b.temp_image.cfdd8b44-81ad-4f40-a3e2-8ef1412b8752gja_ttjo.img Apr 29 06:47:45 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:47:49 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root Apr 29 06:47:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c536c0f4-7ee7-4191-9910-c40278e5c5d8 tempest-VolumesActionsTest-1468389369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b /opt/stack/data/cinder/conversion/be0a4244-7e80-4b88-abef-1ddd66fb470b.temp_image.cfdd8b44-81ad-4f40-a3e2-8ef1412b8752gja_ttjo.img" returned: 0 in 4.092s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:47:49 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1ed8c5-b91a-4af7-a130-4525dac18c38]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:47:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c536c0f4-7ee7-4191-9910-c40278e5c5d8 tempest-VolumesActionsTest-1468389369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:47:49 devstack sudo[92766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b Apr 29 06:47:49 devstack sudo[92766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:47:50 devstack sudo[92766]: pam_unix(sudo:session): session closed for user root Apr 29 06:47:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c536c0f4-7ee7-4191-9910-c40278e5c5d8 tempest-VolumesActionsTest-1468389369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b" returned: 0 in 0.867s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:47:50 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-c536c0f4-7ee7-4191-9910-c40278e5c5d8 tempest-VolumesActionsTest-1468389369 None] Image conversion details: src /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b, size 1024.00 MB, duration 4.09 sec, destination /opt/stack/data/cinder/conversion/be0a4244-7e80-4b88-abef-1ddd66fb470b.temp_image.cfdd8b44-81ad-4f40-a3e2-8ef1412b8752gja_ttjo.img {{(pid=84195) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 06:47:50 devstack cinder-volume[84195]: INFO cinder.image.image_utils [None req-c536c0f4-7ee7-4191-9910-c40278e5c5d8 tempest-VolumesActionsTest-1468389369 None] Converted 1024.00 MB image at 250.17 MB/s Apr 29 06:47:50 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-c536c0f4-7ee7-4191-9910-c40278e5c5d8 tempest-VolumesActionsTest-1468389369 None] cfdd8b44-81ad-4f40-a3e2-8ef1412b8752 was raw, converting to qcow2 {{(pid=84195) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 29 06:47:50 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1431cf2-c10a-438d-8e82-d65d1c881b65]: (4, 'raw') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:47:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c536c0f4-7ee7-4191-9910-c40278e5c5d8 tempest-VolumesActionsTest-1468389369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/be0a4244-7e80-4b88-abef-1ddd66fb470b.temp_image.cfdd8b44-81ad-4f40-a3e2-8ef1412b8752gja_ttjo.img {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:47:50 devstack sudo[92771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/be0a4244-7e80-4b88-abef-1ddd66fb470b.temp_image.cfdd8b44-81ad-4f40-a3e2-8ef1412b8752gja_ttjo.img Apr 29 06:47:50 devstack sudo[92771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:47:51 devstack sudo[92771]: pam_unix(sudo:session): session closed for user root Apr 29 06:47:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c536c0f4-7ee7-4191-9910-c40278e5c5d8 tempest-VolumesActionsTest-1468389369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/be0a4244-7e80-4b88-abef-1ddd66fb470b.temp_image.cfdd8b44-81ad-4f40-a3e2-8ef1412b8752gja_ttjo.img" returned: 0 in 0.654s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:47:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c536c0f4-7ee7-4191-9910-c40278e5c5d8 tempest-VolumesActionsTest-1468389369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/be0a4244-7e80-4b88-abef-1ddd66fb470b.temp_image.cfdd8b44-81ad-4f40-a3e2-8ef1412b8752gja_ttjo.img {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:47:51 devstack sudo[92775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/be0a4244-7e80-4b88-abef-1ddd66fb470b.temp_image.cfdd8b44-81ad-4f40-a3e2-8ef1412b8752gja_ttjo.img Apr 29 06:47:51 devstack sudo[92775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:47:51 devstack sudo[92775]: pam_unix(sudo:session): session closed for user root Apr 29 06:47:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c536c0f4-7ee7-4191-9910-c40278e5c5d8 tempest-VolumesActionsTest-1468389369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/be0a4244-7e80-4b88-abef-1ddd66fb470b.temp_image.cfdd8b44-81ad-4f40-a3e2-8ef1412b8752gja_ttjo.img" returned: 1 in 0.644s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:47:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c536c0f4-7ee7-4191-9910-c40278e5c5d8 tempest-VolumesActionsTest-1468389369 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/be0a4244-7e80-4b88-abef-1ddd66fb470b.temp_image.cfdd8b44-81ad-4f40-a3e2-8ef1412b8752gja_ttjo.img' failed. Not Retrying. {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 06:47:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c536c0f4-7ee7-4191-9910-c40278e5c5d8 tempest-VolumesActionsTest-1468389369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/be0a4244-7e80-4b88-abef-1ddd66fb470b.temp_image.cfdd8b44-81ad-4f40-a3e2-8ef1412b8752gja_ttjo.img /opt/stack/data/cinder/conversion/vol_upload_v6hfw3nn {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:47:51 devstack sudo[92780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/be0a4244-7e80-4b88-abef-1ddd66fb470b.temp_image.cfdd8b44-81ad-4f40-a3e2-8ef1412b8752gja_ttjo.img /opt/stack/data/cinder/conversion/vol_upload_v6hfw3nn Apr 29 06:47:51 devstack sudo[92780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:47:52 devstack sudo[92780]: pam_unix(sudo:session): session closed for user root Apr 29 06:47:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c536c0f4-7ee7-4191-9910-c40278e5c5d8 tempest-VolumesActionsTest-1468389369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/be0a4244-7e80-4b88-abef-1ddd66fb470b.temp_image.cfdd8b44-81ad-4f40-a3e2-8ef1412b8752gja_ttjo.img /opt/stack/data/cinder/conversion/vol_upload_v6hfw3nn" returned: 0 in 0.581s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:47:52 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-c536c0f4-7ee7-4191-9910-c40278e5c5d8 tempest-VolumesActionsTest-1468389369 None] Image conversion details: src /opt/stack/data/cinder/conversion/be0a4244-7e80-4b88-abef-1ddd66fb470b.temp_image.cfdd8b44-81ad-4f40-a3e2-8ef1412b8752gja_ttjo.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_v6hfw3nn {{(pid=84195) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 06:47:52 devstack cinder-volume[84195]: INFO cinder.image.image_utils [None req-c536c0f4-7ee7-4191-9910-c40278e5c5d8 tempest-VolumesActionsTest-1468389369 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 29 06:47:52 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df20eb4-0b39-4cc6-ac49-5d535bdab5a9]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:47:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c536c0f4-7ee7-4191-9910-c40278e5c5d8 tempest-VolumesActionsTest-1468389369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_v6hfw3nn {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:47:52 devstack sudo[92786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_v6hfw3nn Apr 29 06:47:52 devstack sudo[92786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:47:53 devstack sudo[92786]: pam_unix(sudo:session): session closed for user root Apr 29 06:47:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c536c0f4-7ee7-4191-9910-c40278e5c5d8 tempest-VolumesActionsTest-1468389369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_v6hfw3nn" returned: 0 in 0.661s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:47:54 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:47:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c536c0f4-7ee7-4191-9910-c40278e5c5d8 tempest-VolumesActionsTest-1468389369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.096s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:47:54 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c536c0f4-7ee7-4191-9910-c40278e5c5d8 tempest-VolumesActionsTest-1468389369 None] Uploaded volume to glance image-id: cfdd8b44-81ad-4f40-a3e2-8ef1412b8752. {{(pid=84195) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 29 06:47:54 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-c536c0f4-7ee7-4191-9910-c40278e5c5d8 tempest-VolumesActionsTest-1468389369 None] Copy volume to image completed successfully. Apr 29 06:47:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f169be9e-866a-457f-b606-440adfb0d92d tempest-VolumesActionsTest-1468389369 None] Acquiring lock "cinder-be0a4244-7e80-4b88-abef-1ddd66fb470b-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:47:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f169be9e-866a-457f-b606-440adfb0d92d tempest-VolumesActionsTest-1468389369 None] Lock "cinder-be0a4244-7e80-4b88-abef-1ddd66fb470b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:47:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f169be9e-866a-457f-b606-440adfb0d92d tempest-VolumesActionsTest-1468389369 None] Acquiring lock "cinder-quobyte-be0a4244-7e80-4b88-abef-1ddd66fb470b" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:47:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f169be9e-866a-457f-b606-440adfb0d92d tempest-VolumesActionsTest-1468389369 None] Lock "cinder-quobyte-be0a4244-7e80-4b88-abef-1ddd66fb470b" acquired by "delete_volume" :: waited 0.015s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:47:55 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc828fd4-cd6b-4ea3-b1eb-c675377ee0ab]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:47:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f169be9e-866a-457f-b606-440adfb0d92d tempest-VolumesActionsTest-1468389369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:47:55 devstack sudo[92791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b Apr 29 06:47:55 devstack sudo[92791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:47:55 devstack sudo[92791]: pam_unix(sudo:session): session closed for user root Apr 29 06:47:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f169be9e-866a-457f-b606-440adfb0d92d tempest-VolumesActionsTest-1468389369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b" returned: 0 in 0.685s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:47:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f169be9e-866a-457f-b606-440adfb0d92d tempest-VolumesActionsTest-1468389369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:47:55 devstack sudo[92796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b Apr 29 06:47:55 devstack sudo[92796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:47:56 devstack sudo[92796]: pam_unix(sudo:session): session closed for user root Apr 29 06:47:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f169be9e-866a-457f-b606-440adfb0d92d tempest-VolumesActionsTest-1468389369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-be0a4244-7e80-4b88-abef-1ddd66fb470b" returned: 0 in 0.586s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:47:56 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f169be9e-866a-457f-b606-440adfb0d92d tempest-VolumesActionsTest-1468389369 None] Lock "cinder-quobyte-be0a4244-7e80-4b88-abef-1ddd66fb470b" released by "delete_volume" :: held 1.305s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:47:56 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-f169be9e-866a-457f-b606-440adfb0d92d tempest-VolumesActionsTest-1468389369 None] Created reservations ['3e1ea1c5-31ab-4320-b0cb-0d895bf27891', 'f6f5b92f-4631-4fe9-a513-ff365b3eca9c', 'c6485f4a-9ac9-435d-8547-8f99ac62b2ed', 'bb448b38-007d-4d32-bdfd-28b15d34223c'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:47:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f169be9e-866a-457f-b606-440adfb0d92d tempest-VolumesActionsTest-1468389369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:47:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f169be9e-866a-457f-b606-440adfb0d92d tempest-VolumesActionsTest-1468389369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:47:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f169be9e-866a-457f-b606-440adfb0d92d tempest-VolumesActionsTest-1468389369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:47:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f169be9e-866a-457f-b606-440adfb0d92d tempest-VolumesActionsTest-1468389369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:47:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f169be9e-866a-457f-b606-440adfb0d92d tempest-VolumesActionsTest-1468389369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:47:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f169be9e-866a-457f-b606-440adfb0d92d tempest-VolumesActionsTest-1468389369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:47:56 devstack sudo[92800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:47:56 devstack sudo[92800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:47:57 devstack sudo[92800]: pam_unix(sudo:session): session closed for user root Apr 29 06:47:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f169be9e-866a-457f-b606-440adfb0d92d tempest-VolumesActionsTest-1468389369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.594s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:47:57 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-f169be9e-866a-457f-b606-440adfb0d92d tempest-VolumesActionsTest-1468389369 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:47:57 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-f169be9e-866a-457f-b606-440adfb0d92d tempest-VolumesActionsTest-1468389369 None] Deleted volume successfully. Apr 29 06:47:57 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f169be9e-866a-457f-b606-440adfb0d92d tempest-VolumesActionsTest-1468389369 None] Lock "cinder-be0a4244-7e80-4b88-abef-1ddd66fb470b-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:48:02 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:48:02 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Flow 'volume_create_manager' (e658929a-6d14-4300-ab3b-4940979483b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:48:02 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b548b04-c171-439b-b394-43d28977d1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:02 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b548b04-c171-439b-b394-43d28977d1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-827066360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e42320a-e2d6-4493-b40f-ec7d9ab70379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ce794dcda894ca29914383bc3f7d490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:48:02Z,use_quota=True,user_id='6ee1356e47a7492796f89a30d381d4cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:02 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e743bc-e321-40cb-8f38-ed2bff2f91e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:02 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e743bc-e321-40cb-8f38-ed2bff2f91e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:02 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bcf3434-8762-4cb0-9706-6b73ab33c646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:02 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bcf3434-8762-4cb0-9706-6b73ab33c646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e42320a-e2d6-4493-b40f-ec7d9ab70379', 'volume_name': 'volume-1e42320a-e2d6-4493-b40f-ec7d9ab70379', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:02 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c889ac2b-d058-43bf-a72e-1bfd86cbb2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:02 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c889ac2b-d058-43bf-a72e-1bfd86cbb2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:02 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a10e2e0e-5f62-4d9f-9dab-33a7caf69d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:02 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Volume 1e42320a-e2d6-4493-b40f-ec7d9ab70379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e42320a-e2d6-4493-b40f-ec7d9ab70379', 'volume_size': 1} Apr 29 06:48:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:02 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-827066360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e42320a-e2d6-4493-b40f-ec7d9ab70379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ce794dcda894ca29914383bc3f7d490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:48:02Z,use_quota=True,user_id='6ee1356e47a7492796f89a30d381d4cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:48:02 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Creating volume 1e42320a-e2d6-4493-b40f-ec7d9ab70379 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:48:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:02 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:48:02 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:48:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:02 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:48:02 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:48:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1e42320a-e2d6-4493-b40f-ec7d9ab70379 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:02 devstack sudo[92806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1e42320a-e2d6-4493-b40f-ec7d9ab70379 1073741824 Apr 29 06:48:02 devstack sudo[92806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:03 devstack sudo[92806]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1e42320a-e2d6-4493-b40f-ec7d9ab70379 1073741824" returned: 0 in 0.760s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1e42320a-e2d6-4493-b40f-ec7d9ab70379 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:03 devstack sudo[92812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1e42320a-e2d6-4493-b40f-ec7d9ab70379 Apr 29 06:48:03 devstack sudo[92812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:03 devstack sudo[92812]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1e42320a-e2d6-4493-b40f-ec7d9ab70379" returned: 0 in 0.610s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:03 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:48:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:03 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a10e2e0e-5f62-4d9f-9dab-33a7caf69d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e42320a-e2d6-4493-b40f-ec7d9ab70379', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:03 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33aafcd8-51a2-4a4c-a92e-94c2ede80e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:03 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Volume volume-1e42320a-e2d6-4493-b40f-ec7d9ab70379 (1e42320a-e2d6-4493-b40f-ec7d9ab70379): created successfully Apr 29 06:48:03 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33aafcd8-51a2-4a4c-a92e-94c2ede80e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:03 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Flow 'volume_create_manager' (e658929a-6d14-4300-ab3b-4940979483b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:48:03 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-b6b84ba0-917e-4d0a-b13f-45d9665ddfa9 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Created volume successfully. Apr 29 06:48:04 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:48:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Flow 'volume_create_manager' (1666d0bc-0f87-493d-bccb-a848f93549a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:48:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d0db3e-6ee2-4990-9530-8f7670925212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d0db3e-6ee2-4990-9530-8f7670925212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-177131510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89871fb-a6d0-4177-93e4-720cb7a443a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ce794dcda894ca29914383bc3f7d490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:48:05Z,use_quota=True,user_id='6ee1356e47a7492796f89a30d381d4cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acf9252f-afe1-4948-a544-5367aa8e3783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acf9252f-afe1-4948-a544-5367aa8e3783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (048b8fac-8b6e-4e81-8932-2eea2dfe452f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (048b8fac-8b6e-4e81-8932-2eea2dfe452f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c89871fb-a6d0-4177-93e4-720cb7a443a2', 'volume_name': 'volume-c89871fb-a6d0-4177-93e4-720cb7a443a2', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02441c2a-0d44-4bc6-a713-ac15c09b9f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02441c2a-0d44-4bc6-a713-ac15c09b9f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef721ce5-3155-482f-98d1-8708921b8de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:04 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Volume c89871fb-a6d0-4177-93e4-720cb7a443a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c89871fb-a6d0-4177-93e4-720cb7a443a2', 'volume_size': 1} Apr 29 06:48:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-177131510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89871fb-a6d0-4177-93e4-720cb7a443a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ce794dcda894ca29914383bc3f7d490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:48:05Z,use_quota=True,user_id='6ee1356e47a7492796f89a30d381d4cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:48:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Creating volume c89871fb-a6d0-4177-93e4-720cb7a443a2 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:48:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:48:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:48:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:48:04 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:48:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c89871fb-a6d0-4177-93e4-720cb7a443a2 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:04 devstack sudo[92815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c89871fb-a6d0-4177-93e4-720cb7a443a2 1073741824 Apr 29 06:48:04 devstack sudo[92815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Flow 'volume_create_manager' (239e1a22-da0b-48dc-9607-08a1df1266b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b62dc90-5c73-46fd-bed5-7e43e4db8c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b62dc90-5c73-46fd-bed5-7e43e4db8c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1466241467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0236d37-4a17-4991-9193-bcfa68e6e7f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ce794dcda894ca29914383bc3f7d490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:48:05Z,use_quota=True,user_id='6ee1356e47a7492796f89a30d381d4cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1429884-5650-490d-a7bb-b160db308a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1429884-5650-490d-a7bb-b160db308a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e0221f-d174-4ffe-bbe9-baa58b92958b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e0221f-d174-4ffe-bbe9-baa58b92958b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0236d37-4a17-4991-9193-bcfa68e6e7f3', 'volume_name': 'volume-e0236d37-4a17-4991-9193-bcfa68e6e7f3', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2795e37-8cf9-4c7b-9257-d2c4e5e03629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2795e37-8cf9-4c7b-9257-d2c4e5e03629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64528fc3-4319-4e8b-b487-1c86be5a3854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:05 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Volume e0236d37-4a17-4991-9193-bcfa68e6e7f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0236d37-4a17-4991-9193-bcfa68e6e7f3', 'volume_size': 1} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Flow 'volume_create_manager' (5078fe6f-51be-42a3-96ef-a6b82f7327ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b88c5470-60f8-49c4-88af-61df293157aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b88c5470-60f8-49c4-88af-61df293157aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-353460876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3638c01f-4b5c-4879-a47f-7a489fe214cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ce794dcda894ca29914383bc3f7d490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:48:05Z,use_quota=True,user_id='6ee1356e47a7492796f89a30d381d4cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df14f49-80b8-4465-904c-c1083a0922b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df14f49-80b8-4465-904c-c1083a0922b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98107bec-b805-41ac-a275-529b27418763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98107bec-b805-41ac-a275-529b27418763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3638c01f-4b5c-4879-a47f-7a489fe214cb', 'volume_name': 'volume-3638c01f-4b5c-4879-a47f-7a489fe214cb', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0785710-b676-4a98-af20-d280f02dda7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0785710-b676-4a98-af20-d280f02dda7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938443c0-cb79-4652-b712-aea519dc6093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:05 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Volume 3638c01f-4b5c-4879-a47f-7a489fe214cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3638c01f-4b5c-4879-a47f-7a489fe214cb', 'volume_size': 1} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:48:05 devstack sudo[92815]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Flow 'volume_create_manager' (a93136c5-2089-4956-a2a0-3cdf3a4ef177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (772d0c75-9979-4e43-9123-63876c4a618c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c89871fb-a6d0-4177-93e4-720cb7a443a2 1073741824" returned: 0 in 0.926s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (772d0c75-9979-4e43-9123-63876c4a618c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2062193020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf0cd08a-8682-4296-9e66-a413b94336df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ce794dcda894ca29914383bc3f7d490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:48:06Z,use_quota=True,user_id='6ee1356e47a7492796f89a30d381d4cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32cdd265-93a2-4e6e-9354-3313d7492df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32cdd265-93a2-4e6e-9354-3313d7492df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77da91b3-5bd6-4101-87ce-9926c2c54a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77da91b3-5bd6-4101-87ce-9926c2c54a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf0cd08a-8682-4296-9e66-a413b94336df', 'volume_name': 'volume-cf0cd08a-8682-4296-9e66-a413b94336df', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55eed82d-9f92-4639-ac54-51b7b025310b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55eed82d-9f92-4639-ac54-51b7b025310b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c862ec3e-ac26-4fe1-9dde-626a5cdf2a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:05 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Volume cf0cd08a-8682-4296-9e66-a413b94336df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf0cd08a-8682-4296-9e66-a413b94336df', 'volume_size': 1} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c89871fb-a6d0-4177-93e4-720cb7a443a2 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:06 devstack sudo[92821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c89871fb-a6d0-4177-93e4-720cb7a443a2 Apr 29 06:48:06 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Flow 'volume_create_manager' (70fa5735-8da1-4aff-a9a0-2aada9e59492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e8d48c2-b550-479f-aac7-ae3bfd24133f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e8d48c2-b550-479f-aac7-ae3bfd24133f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-855338994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=834db7be-0668-43c4-abe1-522706039b06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ce794dcda894ca29914383bc3f7d490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:48:06Z,use_quota=True,user_id='6ee1356e47a7492796f89a30d381d4cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce62915-49ae-43c9-ad05-f09a21189a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce62915-49ae-43c9-ad05-f09a21189a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be273084-ad78-45ea-880c-a35ff62babf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be273084-ad78-45ea-880c-a35ff62babf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '834db7be-0668-43c4-abe1-522706039b06', 'volume_name': 'volume-834db7be-0668-43c4-abe1-522706039b06', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d211b8-9693-45f6-84c2-e5e3b0d5914a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d211b8-9693-45f6-84c2-e5e3b0d5914a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfed8739-3702-4935-a410-9994a7b3353f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:06 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Volume 834db7be-0668-43c4-abe1-522706039b06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-834db7be-0668-43c4-abe1-522706039b06', 'volume_size': 1} Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:06 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c89871fb-a6d0-4177-93e4-720cb7a443a2" returned: 0 in 0.617s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.360s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1466241467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0236d37-4a17-4991-9193-bcfa68e6e7f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ce794dcda894ca29914383bc3f7d490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:48:05Z,use_quota=True,user_id='6ee1356e47a7492796f89a30d381d4cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Creating volume e0236d37-4a17-4991-9193-bcfa68e6e7f3 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:48:06 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e0236d37-4a17-4991-9193-bcfa68e6e7f3 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef721ce5-3155-482f-98d1-8708921b8de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c89871fb-a6d0-4177-93e4-720cb7a443a2', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97af075d-fbfe-444a-943e-b629a9552514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:06 devstack sudo[92825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e0236d37-4a17-4991-9193-bcfa68e6e7f3 1073741824 Apr 29 06:48:06 devstack sudo[92825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:06 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Volume volume-c89871fb-a6d0-4177-93e4-720cb7a443a2 (c89871fb-a6d0-4177-93e4-720cb7a443a2): created successfully Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97af075d-fbfe-444a-943e-b629a9552514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Flow 'volume_create_manager' (1666d0bc-0f87-493d-bccb-a848f93549a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:48:06 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-44c7cab4-6ce9-4454-8a45-d91c4b125364 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Created volume successfully. Apr 29 06:48:07 devstack sudo[92825]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e0236d37-4a17-4991-9193-bcfa68e6e7f3 1073741824" returned: 0 in 0.765s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e0236d37-4a17-4991-9193-bcfa68e6e7f3 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:07 devstack sudo[92831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e0236d37-4a17-4991-9193-bcfa68e6e7f3 Apr 29 06:48:07 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:08 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e0236d37-4a17-4991-9193-bcfa68e6e7f3" returned: 0 in 0.575s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:48:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.439s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-353460876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3638c01f-4b5c-4879-a47f-7a489fe214cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ce794dcda894ca29914383bc3f7d490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:48:05Z,use_quota=True,user_id='6ee1356e47a7492796f89a30d381d4cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:48:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Creating volume 3638c01f-4b5c-4879-a47f-7a489fe214cb {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:48:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:48:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:48:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:48:08 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:48:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3638c01f-4b5c-4879-a47f-7a489fe214cb 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:08 devstack sudo[92834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3638c01f-4b5c-4879-a47f-7a489fe214cb 1073741824 Apr 29 06:48:08 devstack sudo[92834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64528fc3-4319-4e8b-b487-1c86be5a3854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0236d37-4a17-4991-9193-bcfa68e6e7f3', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b7004a-b5f8-407c-a60f-b32e2e0fe0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:08 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Volume volume-e0236d37-4a17-4991-9193-bcfa68e6e7f3 (e0236d37-4a17-4991-9193-bcfa68e6e7f3): created successfully Apr 29 06:48:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b7004a-b5f8-407c-a60f-b32e2e0fe0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Flow 'volume_create_manager' (239e1a22-da0b-48dc-9607-08a1df1266b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:48:08 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-d74badee-de03-4d69-a9a4-28da6b70162c tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Created volume successfully. Apr 29 06:48:08 devstack sudo[92834]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3638c01f-4b5c-4879-a47f-7a489fe214cb 1073741824" returned: 0 in 0.815s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3638c01f-4b5c-4879-a47f-7a489fe214cb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:08 devstack sudo[92839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3638c01f-4b5c-4879-a47f-7a489fe214cb Apr 29 06:48:08 devstack sudo[92839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:09 devstack sudo[92839]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3638c01f-4b5c-4879-a47f-7a489fe214cb" returned: 0 in 0.613s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:09 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:48:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.564s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:09 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2062193020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf0cd08a-8682-4296-9e66-a413b94336df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ce794dcda894ca29914383bc3f7d490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:48:06Z,use_quota=True,user_id='6ee1356e47a7492796f89a30d381d4cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:48:09 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Creating volume cf0cd08a-8682-4296-9e66-a413b94336df {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:48:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:09 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:48:09 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:48:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:09 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:48:09 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:48:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-cf0cd08a-8682-4296-9e66-a413b94336df 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:09 devstack sudo[92842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-cf0cd08a-8682-4296-9e66-a413b94336df 1073741824 Apr 29 06:48:09 devstack sudo[92842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938443c0-cb79-4652-b712-aea519dc6093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3638c01f-4b5c-4879-a47f-7a489fe214cb', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8855d5-235c-4858-b05d-ba23f2449287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:09 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Volume volume-3638c01f-4b5c-4879-a47f-7a489fe214cb (3638c01f-4b5c-4879-a47f-7a489fe214cb): created successfully Apr 29 06:48:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8855d5-235c-4858-b05d-ba23f2449287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Flow 'volume_create_manager' (5078fe6f-51be-42a3-96ef-a6b82f7327ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:48:09 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-0ace3677-0cac-4a7c-b688-f7412a9d4682 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Created volume successfully. Apr 29 06:48:10 devstack sudo[92842]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-cf0cd08a-8682-4296-9e66-a413b94336df 1073741824" returned: 0 in 0.744s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-cf0cd08a-8682-4296-9e66-a413b94336df {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:10 devstack sudo[92847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-cf0cd08a-8682-4296-9e66-a413b94336df Apr 29 06:48:10 devstack sudo[92847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:10 devstack sudo[92847]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-cf0cd08a-8682-4296-9e66-a413b94336df" returned: 0 in 0.599s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:10 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:48:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.597s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:10 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-855338994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=834db7be-0668-43c4-abe1-522706039b06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ce794dcda894ca29914383bc3f7d490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:48:06Z,use_quota=True,user_id='6ee1356e47a7492796f89a30d381d4cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:48:10 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Creating volume 834db7be-0668-43c4-abe1-522706039b06 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:48:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:10 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:48:10 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:48:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:10 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:48:10 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:48:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-834db7be-0668-43c4-abe1-522706039b06 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c862ec3e-ac26-4fe1-9dde-626a5cdf2a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf0cd08a-8682-4296-9e66-a413b94336df', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:10 devstack sudo[92850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-834db7be-0668-43c4-abe1-522706039b06 1073741824 Apr 29 06:48:10 devstack sudo[92850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccff4ae7-fb49-46ad-82b1-7ff160fecadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:10 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Volume volume-cf0cd08a-8682-4296-9e66-a413b94336df (cf0cd08a-8682-4296-9e66-a413b94336df): created successfully Apr 29 06:48:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccff4ae7-fb49-46ad-82b1-7ff160fecadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Flow 'volume_create_manager' (a93136c5-2089-4956-a2a0-3cdf3a4ef177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:48:10 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-7569e5bb-f07a-4e54-8482-01f3c92ca1c3 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Created volume successfully. Apr 29 06:48:11 devstack sudo[92850]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-834db7be-0668-43c4-abe1-522706039b06 1073741824" returned: 0 in 0.772s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-834db7be-0668-43c4-abe1-522706039b06 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:11 devstack sudo[92855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-834db7be-0668-43c4-abe1-522706039b06 Apr 29 06:48:11 devstack sudo[92855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:12 devstack sudo[92855]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-834db7be-0668-43c4-abe1-522706039b06" returned: 0 in 0.593s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:12 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:48:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.408s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:12 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfed8739-3702-4935-a410-9994a7b3353f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-834db7be-0668-43c4-abe1-522706039b06', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:12 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93588ad2-37a7-4002-b050-5178fb0c6584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:12 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Volume volume-834db7be-0668-43c4-abe1-522706039b06 (834db7be-0668-43c4-abe1-522706039b06): created successfully Apr 29 06:48:12 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93588ad2-37a7-4002-b050-5178fb0c6584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:12 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Flow 'volume_create_manager' (70fa5735-8da1-4aff-a9a0-2aada9e59492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:48:12 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-e46f0d5e-654b-4971-b873-d395b0df0158 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Created volume successfully. Apr 29 06:48:12 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9617ec68-e9e9-4265-9314-a1e9b2f35360 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "cinder-834db7be-0668-43c4-abe1-522706039b06-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:48:12 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9617ec68-e9e9-4265-9314-a1e9b2f35360 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "cinder-834db7be-0668-43c4-abe1-522706039b06-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:48:12 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9617ec68-e9e9-4265-9314-a1e9b2f35360 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "cinder-quobyte-834db7be-0668-43c4-abe1-522706039b06" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:48:12 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9617ec68-e9e9-4265-9314-a1e9b2f35360 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "cinder-quobyte-834db7be-0668-43c4-abe1-522706039b06" acquired by "delete_volume" :: waited 0.018s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:48:12 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead28661-cb15-475b-b54e-1fe892577b2b]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:48:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9617ec68-e9e9-4265-9314-a1e9b2f35360 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-834db7be-0668-43c4-abe1-522706039b06 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:13 devstack sudo[92858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-834db7be-0668-43c4-abe1-522706039b06 Apr 29 06:48:13 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:13 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9617ec68-e9e9-4265-9314-a1e9b2f35360 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-834db7be-0668-43c4-abe1-522706039b06" returned: 0 in 0.700s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9617ec68-e9e9-4265-9314-a1e9b2f35360 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-834db7be-0668-43c4-abe1-522706039b06 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:13 devstack sudo[92863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-834db7be-0668-43c4-abe1-522706039b06 Apr 29 06:48:13 devstack sudo[92863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:14 devstack sudo[92863]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9617ec68-e9e9-4265-9314-a1e9b2f35360 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-834db7be-0668-43c4-abe1-522706039b06" returned: 0 in 0.604s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:14 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9617ec68-e9e9-4265-9314-a1e9b2f35360 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "cinder-quobyte-834db7be-0668-43c4-abe1-522706039b06" released by "delete_volume" :: held 1.345s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:48:14 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-9617ec68-e9e9-4265-9314-a1e9b2f35360 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Created reservations ['df3a082e-ded4-48b3-afad-6c52bebae21e', 'fb982e72-aeb9-4a17-be53-1510d4bdbc24', '141d386a-3008-42c9-819e-3f64fcc6d340', 'ac44fa78-e21b-49bb-81c6-e8c94390c7fd'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:48:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9617ec68-e9e9-4265-9314-a1e9b2f35360 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9617ec68-e9e9-4265-9314-a1e9b2f35360 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:14 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9617ec68-e9e9-4265-9314-a1e9b2f35360 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:48:14 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9617ec68-e9e9-4265-9314-a1e9b2f35360 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:48:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9617ec68-e9e9-4265-9314-a1e9b2f35360 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9617ec68-e9e9-4265-9314-a1e9b2f35360 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:14 devstack sudo[92866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:48:14 devstack sudo[92866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:14 devstack sudo[92866]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9617ec68-e9e9-4265-9314-a1e9b2f35360 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.589s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:14 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-9617ec68-e9e9-4265-9314-a1e9b2f35360 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:48:14 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-9617ec68-e9e9-4265-9314-a1e9b2f35360 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Deleted volume successfully. Apr 29 06:48:14 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9617ec68-e9e9-4265-9314-a1e9b2f35360 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "cinder-834db7be-0668-43c4-abe1-522706039b06-delete_volume" released by "delete_volume" :: held 2.119s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:48:15 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7579b61a-27c5-410b-90c6-dbf1867d5c73 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "cinder-cf0cd08a-8682-4296-9e66-a413b94336df-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:48:15 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7579b61a-27c5-410b-90c6-dbf1867d5c73 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "cinder-cf0cd08a-8682-4296-9e66-a413b94336df-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:48:15 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7579b61a-27c5-410b-90c6-dbf1867d5c73 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "cinder-quobyte-cf0cd08a-8682-4296-9e66-a413b94336df" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:48:15 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7579b61a-27c5-410b-90c6-dbf1867d5c73 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "cinder-quobyte-cf0cd08a-8682-4296-9e66-a413b94336df" acquired by "delete_volume" :: waited 0.014s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:48:15 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eccf7ce-b5e3-422e-ac54-52aff4a52368]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:48:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7579b61a-27c5-410b-90c6-dbf1867d5c73 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-cf0cd08a-8682-4296-9e66-a413b94336df {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:15 devstack sudo[92869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-cf0cd08a-8682-4296-9e66-a413b94336df Apr 29 06:48:15 devstack sudo[92869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:15 devstack sudo[92869]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7579b61a-27c5-410b-90c6-dbf1867d5c73 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-cf0cd08a-8682-4296-9e66-a413b94336df" returned: 0 in 0.711s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7579b61a-27c5-410b-90c6-dbf1867d5c73 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-cf0cd08a-8682-4296-9e66-a413b94336df {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:15 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-cf0cd08a-8682-4296-9e66-a413b94336df Apr 29 06:48:15 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:16 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7579b61a-27c5-410b-90c6-dbf1867d5c73 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-cf0cd08a-8682-4296-9e66-a413b94336df" returned: 0 in 0.609s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:16 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7579b61a-27c5-410b-90c6-dbf1867d5c73 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "cinder-quobyte-cf0cd08a-8682-4296-9e66-a413b94336df" released by "delete_volume" :: held 1.359s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:48:16 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-7579b61a-27c5-410b-90c6-dbf1867d5c73 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Created reservations ['5108c39a-f431-492d-9c7b-3debe2fd7492', '6532beba-ecd9-45ed-9b66-94699d79b91d', '26b84e64-fa23-4186-b4f8-4257c37008cb', '713c6182-b0c0-4d70-81a1-131b035703c5'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:48:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7579b61a-27c5-410b-90c6-dbf1867d5c73 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7579b61a-27c5-410b-90c6-dbf1867d5c73 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:16 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-7579b61a-27c5-410b-90c6-dbf1867d5c73 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:48:16 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-7579b61a-27c5-410b-90c6-dbf1867d5c73 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:48:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7579b61a-27c5-410b-90c6-dbf1867d5c73 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7579b61a-27c5-410b-90c6-dbf1867d5c73 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:16 devstack sudo[92877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:48:16 devstack sudo[92877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:17 devstack sudo[92877]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7579b61a-27c5-410b-90c6-dbf1867d5c73 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.593s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:17 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-7579b61a-27c5-410b-90c6-dbf1867d5c73 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:48:17 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-7579b61a-27c5-410b-90c6-dbf1867d5c73 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Deleted volume successfully. Apr 29 06:48:17 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7579b61a-27c5-410b-90c6-dbf1867d5c73 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "cinder-cf0cd08a-8682-4296-9e66-a413b94336df-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:48:17 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-76e2f283-b2de-40af-997b-eab3dcc08a76 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "cinder-3638c01f-4b5c-4879-a47f-7a489fe214cb-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:48:17 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-76e2f283-b2de-40af-997b-eab3dcc08a76 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "cinder-3638c01f-4b5c-4879-a47f-7a489fe214cb-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:48:17 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-76e2f283-b2de-40af-997b-eab3dcc08a76 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "cinder-quobyte-3638c01f-4b5c-4879-a47f-7a489fe214cb" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:48:17 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-76e2f283-b2de-40af-997b-eab3dcc08a76 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "cinder-quobyte-3638c01f-4b5c-4879-a47f-7a489fe214cb" acquired by "delete_volume" :: waited 0.016s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:48:17 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52ccbe0-14cb-4c06-ba81-f08a63f73013]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:48:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-76e2f283-b2de-40af-997b-eab3dcc08a76 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3638c01f-4b5c-4879-a47f-7a489fe214cb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:17 devstack sudo[92881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3638c01f-4b5c-4879-a47f-7a489fe214cb Apr 29 06:48:17 devstack sudo[92881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:18 devstack sudo[92881]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-76e2f283-b2de-40af-997b-eab3dcc08a76 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3638c01f-4b5c-4879-a47f-7a489fe214cb" returned: 0 in 0.723s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-76e2f283-b2de-40af-997b-eab3dcc08a76 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3638c01f-4b5c-4879-a47f-7a489fe214cb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:18 devstack sudo[92886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3638c01f-4b5c-4879-a47f-7a489fe214cb Apr 29 06:48:18 devstack sudo[92886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:18 devstack sudo[92886]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-76e2f283-b2de-40af-997b-eab3dcc08a76 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-3638c01f-4b5c-4879-a47f-7a489fe214cb" returned: 0 in 0.591s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:18 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-76e2f283-b2de-40af-997b-eab3dcc08a76 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "cinder-quobyte-3638c01f-4b5c-4879-a47f-7a489fe214cb" released by "delete_volume" :: held 1.352s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:48:18 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-76e2f283-b2de-40af-997b-eab3dcc08a76 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Created reservations ['d315a0bf-2ce3-48e0-9121-e5311203d1ad', '2a527360-fb32-4f8d-8e0a-5babcd83fb7a', '6dcb0157-497b-474b-9c22-404aeb2f29da', '2365328a-4671-45aa-974c-681c0d53ac9f'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:48:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-76e2f283-b2de-40af-997b-eab3dcc08a76 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-76e2f283-b2de-40af-997b-eab3dcc08a76 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-76e2f283-b2de-40af-997b-eab3dcc08a76 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:48:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-76e2f283-b2de-40af-997b-eab3dcc08a76 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:48:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-76e2f283-b2de-40af-997b-eab3dcc08a76 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-76e2f283-b2de-40af-997b-eab3dcc08a76 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:18 devstack sudo[92889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:48:18 devstack sudo[92889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:19 devstack sudo[92889]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-76e2f283-b2de-40af-997b-eab3dcc08a76 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.593s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:19 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-76e2f283-b2de-40af-997b-eab3dcc08a76 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:48:19 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-76e2f283-b2de-40af-997b-eab3dcc08a76 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Deleted volume successfully. Apr 29 06:48:19 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-76e2f283-b2de-40af-997b-eab3dcc08a76 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "cinder-3638c01f-4b5c-4879-a47f-7a489fe214cb-delete_volume" released by "delete_volume" :: held 2.124s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:48:19 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-91d34953-4c9b-4b93-93d7-e047e8491e5d tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "cinder-e0236d37-4a17-4991-9193-bcfa68e6e7f3-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:48:19 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-91d34953-4c9b-4b93-93d7-e047e8491e5d tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "cinder-e0236d37-4a17-4991-9193-bcfa68e6e7f3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:48:19 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-91d34953-4c9b-4b93-93d7-e047e8491e5d tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "cinder-quobyte-e0236d37-4a17-4991-9193-bcfa68e6e7f3" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:48:19 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-91d34953-4c9b-4b93-93d7-e047e8491e5d tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "cinder-quobyte-e0236d37-4a17-4991-9193-bcfa68e6e7f3" acquired by "delete_volume" :: waited 0.012s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:48:19 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[b504ce7a-0aa1-4b6f-9b86-fb9f34387f3b]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:48:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-91d34953-4c9b-4b93-93d7-e047e8491e5d tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e0236d37-4a17-4991-9193-bcfa68e6e7f3 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:19 devstack sudo[92892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e0236d37-4a17-4991-9193-bcfa68e6e7f3 Apr 29 06:48:19 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:20 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-91d34953-4c9b-4b93-93d7-e047e8491e5d tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e0236d37-4a17-4991-9193-bcfa68e6e7f3" returned: 0 in 0.686s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-91d34953-4c9b-4b93-93d7-e047e8491e5d tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e0236d37-4a17-4991-9193-bcfa68e6e7f3 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:20 devstack sudo[92897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e0236d37-4a17-4991-9193-bcfa68e6e7f3 Apr 29 06:48:20 devstack sudo[92897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:20 devstack sudo[92897]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-91d34953-4c9b-4b93-93d7-e047e8491e5d tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e0236d37-4a17-4991-9193-bcfa68e6e7f3" returned: 0 in 0.605s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:20 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-91d34953-4c9b-4b93-93d7-e047e8491e5d tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "cinder-quobyte-e0236d37-4a17-4991-9193-bcfa68e6e7f3" released by "delete_volume" :: held 1.331s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:48:20 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-91d34953-4c9b-4b93-93d7-e047e8491e5d tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Created reservations ['00f027c8-bcaa-441e-9d91-7a778f116d41', '55cfd038-0281-45ce-bfa2-0e2b3010967d', 'cf06df9d-cf7e-4971-95f4-d4c4236bab34', '4dc86118-cff3-4897-bfcd-c376bcd899c5'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:48:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-91d34953-4c9b-4b93-93d7-e047e8491e5d tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-91d34953-4c9b-4b93-93d7-e047e8491e5d tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-91d34953-4c9b-4b93-93d7-e047e8491e5d tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:48:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-91d34953-4c9b-4b93-93d7-e047e8491e5d tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:48:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-91d34953-4c9b-4b93-93d7-e047e8491e5d tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-91d34953-4c9b-4b93-93d7-e047e8491e5d tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:20 devstack sudo[92900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:48:20 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:21 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-91d34953-4c9b-4b93-93d7-e047e8491e5d tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.587s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:21 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-91d34953-4c9b-4b93-93d7-e047e8491e5d tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:48:21 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-91d34953-4c9b-4b93-93d7-e047e8491e5d tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Deleted volume successfully. Apr 29 06:48:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-91d34953-4c9b-4b93-93d7-e047e8491e5d tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "cinder-e0236d37-4a17-4991-9193-bcfa68e6e7f3-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:48:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3c632b68-7cb1-465c-9a69-0a65e90f067e tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "cinder-c89871fb-a6d0-4177-93e4-720cb7a443a2-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:48:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3c632b68-7cb1-465c-9a69-0a65e90f067e tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "cinder-c89871fb-a6d0-4177-93e4-720cb7a443a2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:48:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3c632b68-7cb1-465c-9a69-0a65e90f067e tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "cinder-quobyte-c89871fb-a6d0-4177-93e4-720cb7a443a2" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:48:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3c632b68-7cb1-465c-9a69-0a65e90f067e tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "cinder-quobyte-c89871fb-a6d0-4177-93e4-720cb7a443a2" acquired by "delete_volume" :: waited 0.017s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:48:21 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[9745f43a-e169-48dd-8ce3-f28404d1333e]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:48:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3c632b68-7cb1-465c-9a69-0a65e90f067e tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c89871fb-a6d0-4177-93e4-720cb7a443a2 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:21 devstack sudo[92903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c89871fb-a6d0-4177-93e4-720cb7a443a2 Apr 29 06:48:21 devstack sudo[92903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:22 devstack sudo[92903]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3c632b68-7cb1-465c-9a69-0a65e90f067e tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c89871fb-a6d0-4177-93e4-720cb7a443a2" returned: 0 in 0.713s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3c632b68-7cb1-465c-9a69-0a65e90f067e tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c89871fb-a6d0-4177-93e4-720cb7a443a2 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:22 devstack sudo[92908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c89871fb-a6d0-4177-93e4-720cb7a443a2 Apr 29 06:48:22 devstack sudo[92908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:23 devstack sudo[92908]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3c632b68-7cb1-465c-9a69-0a65e90f067e tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c89871fb-a6d0-4177-93e4-720cb7a443a2" returned: 0 in 0.606s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:23 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3c632b68-7cb1-465c-9a69-0a65e90f067e tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "cinder-quobyte-c89871fb-a6d0-4177-93e4-720cb7a443a2" released by "delete_volume" :: held 1.359s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:48:23 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-3c632b68-7cb1-465c-9a69-0a65e90f067e tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Created reservations ['1b4b431a-e752-471c-bd8b-23ee3390bf88', '51fc14fa-6224-484b-b6a0-f14f4c3fd132', '1947665f-8459-49a5-a90b-e73ee7526386', '549575dc-b8a5-4428-846e-bf94ad0e61a2'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:48:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3c632b68-7cb1-465c-9a69-0a65e90f067e tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3c632b68-7cb1-465c-9a69-0a65e90f067e tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:23 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-3c632b68-7cb1-465c-9a69-0a65e90f067e tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:48:23 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-3c632b68-7cb1-465c-9a69-0a65e90f067e tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:48:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-3c632b68-7cb1-465c-9a69-0a65e90f067e tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3c632b68-7cb1-465c-9a69-0a65e90f067e tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:23 devstack sudo[92912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:48:23 devstack sudo[92912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:23 devstack sudo[92912]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-3c632b68-7cb1-465c-9a69-0a65e90f067e tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.587s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:23 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-3c632b68-7cb1-465c-9a69-0a65e90f067e tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:48:23 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-3c632b68-7cb1-465c-9a69-0a65e90f067e tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Deleted volume successfully. Apr 29 06:48:23 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-3c632b68-7cb1-465c-9a69-0a65e90f067e tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "cinder-c89871fb-a6d0-4177-93e4-720cb7a443a2-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:48:23 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5c1f69ca-2908-4655-b91d-c8ffd1eeb020 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "cinder-1e42320a-e2d6-4493-b40f-ec7d9ab70379-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:48:23 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5c1f69ca-2908-4655-b91d-c8ffd1eeb020 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "cinder-1e42320a-e2d6-4493-b40f-ec7d9ab70379-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:48:23 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5c1f69ca-2908-4655-b91d-c8ffd1eeb020 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "cinder-quobyte-1e42320a-e2d6-4493-b40f-ec7d9ab70379" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:48:23 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5c1f69ca-2908-4655-b91d-c8ffd1eeb020 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "cinder-quobyte-1e42320a-e2d6-4493-b40f-ec7d9ab70379" acquired by "delete_volume" :: waited 0.014s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:48:23 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[9040cbfd-09e2-4531-9322-3f0fd476077b]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:48:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5c1f69ca-2908-4655-b91d-c8ffd1eeb020 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1e42320a-e2d6-4493-b40f-ec7d9ab70379 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:24 devstack sudo[92915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1e42320a-e2d6-4493-b40f-ec7d9ab70379 Apr 29 06:48:24 devstack sudo[92915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:24 devstack sudo[92915]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5c1f69ca-2908-4655-b91d-c8ffd1eeb020 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1e42320a-e2d6-4493-b40f-ec7d9ab70379" returned: 0 in 0.726s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5c1f69ca-2908-4655-b91d-c8ffd1eeb020 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1e42320a-e2d6-4493-b40f-ec7d9ab70379 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:24 devstack sudo[92920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1e42320a-e2d6-4493-b40f-ec7d9ab70379 Apr 29 06:48:24 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:25 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5c1f69ca-2908-4655-b91d-c8ffd1eeb020 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-1e42320a-e2d6-4493-b40f-ec7d9ab70379" returned: 0 in 0.590s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:25 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5c1f69ca-2908-4655-b91d-c8ffd1eeb020 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "cinder-quobyte-1e42320a-e2d6-4493-b40f-ec7d9ab70379" released by "delete_volume" :: held 1.358s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:48:25 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-5c1f69ca-2908-4655-b91d-c8ffd1eeb020 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Created reservations ['1fc29c30-b88f-41c9-bcd5-0ce360e16356', '48879790-4d13-4d0e-8100-091b91078188', '65e052ed-0a3b-484e-beec-8071f3e98853', 'c944032c-25a8-4260-af52-f58a358c7f2d'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:48:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5c1f69ca-2908-4655-b91d-c8ffd1eeb020 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5c1f69ca-2908-4655-b91d-c8ffd1eeb020 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:25 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5c1f69ca-2908-4655-b91d-c8ffd1eeb020 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:48:25 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5c1f69ca-2908-4655-b91d-c8ffd1eeb020 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:48:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5c1f69ca-2908-4655-b91d-c8ffd1eeb020 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5c1f69ca-2908-4655-b91d-c8ffd1eeb020 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:25 devstack sudo[92923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:48:25 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:26 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5c1f69ca-2908-4655-b91d-c8ffd1eeb020 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.602s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:26 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-5c1f69ca-2908-4655-b91d-c8ffd1eeb020 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:48:26 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-5c1f69ca-2908-4655-b91d-c8ffd1eeb020 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Deleted volume successfully. Apr 29 06:48:26 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-5c1f69ca-2908-4655-b91d-c8ffd1eeb020 tempest-CreateVolumesFromSourceVolumeTest-1689612224 None] Lock "cinder-1e42320a-e2d6-4493-b40f-ec7d9ab70379-delete_volume" released by "delete_volume" :: held 2.137s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:48:28 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:48:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Flow 'volume_create_manager' (52922319-a99d-4948-9081-3dfa14c11e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:48:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (463c0c06-901f-410d-aeae-bd35c216a3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (463c0c06-901f-410d-aeae-bd35c216a3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-856871459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d29cf860-873f-4f47-a25e-b8202921be40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc68427a4fd401bae4b64c1cb454d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:48:29Z,use_quota=True,user_id='dee569291b7b4c0797a3eeee6f1b8249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f91b5f6-4b03-4cae-b8a2-b4f4f1f34d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f91b5f6-4b03-4cae-b8a2-b4f4f1f34d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3b5543-c8e4-4f5f-8924-ba02d2eea9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3b5543-c8e4-4f5f-8924-ba02d2eea9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd29cf860-873f-4f47-a25e-b8202921be40', 'volume_name': 'volume-d29cf860-873f-4f47-a25e-b8202921be40', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eddc193b-7e78-44fc-978d-a175d957ab6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eddc193b-7e78-44fc-978d-a175d957ab6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3532f53-2bc9-4adb-b2d6-b594c7b39ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:28 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Volume d29cf860-873f-4f47-a25e-b8202921be40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d29cf860-873f-4f47-a25e-b8202921be40', 'volume_size': 1} Apr 29 06:48:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:28 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-856871459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d29cf860-873f-4f47-a25e-b8202921be40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc68427a4fd401bae4b64c1cb454d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:48:29Z,use_quota=True,user_id='dee569291b7b4c0797a3eeee6f1b8249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:48:28 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Creating volume d29cf860-873f-4f47-a25e-b8202921be40 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:48:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:28 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:48:28 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:48:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:28 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:48:28 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:48:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:28 devstack sudo[92963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40 1073741824 Apr 29 06:48:28 devstack sudo[92963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:29 devstack sudo[92963]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40 1073741824" returned: 0 in 0.751s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:29 devstack sudo[92969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40 Apr 29 06:48:29 devstack sudo[92969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:30 devstack sudo[92969]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40" returned: 0 in 0.582s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:30 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:48:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:30 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3532f53-2bc9-4adb-b2d6-b594c7b39ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d29cf860-873f-4f47-a25e-b8202921be40', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:30 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a604283-7ada-43e4-a9fb-6d8db15360bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:30 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Volume volume-d29cf860-873f-4f47-a25e-b8202921be40 (d29cf860-873f-4f47-a25e-b8202921be40): created successfully Apr 29 06:48:30 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a604283-7ada-43e4-a9fb-6d8db15360bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:30 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Flow 'volume_create_manager' (52922319-a99d-4948-9081-3dfa14c11e82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:48:30 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-1d65e45e-5350-41d7-86ea-b820e30715b3 tempest-VolumeDependencyTests-1173106783 None] Created volume successfully. Apr 29 06:48:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-0229c44f-c0fc-4af4-abf2-949fb072df79 tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-0229c44f-c0fc-4af4-abf2-949fb072df79 tempest-VolumeDependencyTests-1173106783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:30 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-0229c44f-c0fc-4af4-abf2-949fb072df79 tempest-VolumeDependencyTests-1173106783 None] Creating offline snapshot 1fad562c-19bc-4b16-9cf6-c7531c749a68 of volume d29cf860-873f-4f47-a25e-b8202921be40 {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:48:30 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6b4ac8-a525-4bd1-9c01-86c38ed24ca6]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:48:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0229c44f-c0fc-4af4-abf2-949fb072df79 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:31 devstack sudo[92972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40 Apr 29 06:48:31 devstack sudo[92972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:31 devstack sudo[92972]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0229c44f-c0fc-4af4-abf2-949fb072df79 tempest-VolumeDependencyTests-1173106783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40" returned: 0 in 0.687s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0229c44f-c0fc-4af4-abf2-949fb072df79 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.1fad562c-19bc-4b16-9cf6-c7531c749a68 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:31 devstack sudo[92977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.1fad562c-19bc-4b16-9cf6-c7531c749a68 1G Apr 29 06:48:31 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:32 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0229c44f-c0fc-4af4-abf2-949fb072df79 tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.1fad562c-19bc-4b16-9cf6-c7531c749a68 1G" returned: 0 in 0.730s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0229c44f-c0fc-4af4-abf2-949fb072df79 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d29cf860-873f-4f47-a25e-b8202921be40 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.1fad562c-19bc-4b16-9cf6-c7531c749a68 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:32 devstack sudo[92983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d29cf860-873f-4f47-a25e-b8202921be40 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.1fad562c-19bc-4b16-9cf6-c7531c749a68 Apr 29 06:48:32 devstack sudo[92983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:33 devstack sudo[92983]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0229c44f-c0fc-4af4-abf2-949fb072df79 tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d29cf860-873f-4f47-a25e-b8202921be40 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.1fad562c-19bc-4b16-9cf6-c7531c749a68" returned: 0 in 0.622s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:33 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-0229c44f-c0fc-4af4-abf2-949fb072df79 tempest-VolumeDependencyTests-1173106783 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.1fad562c-19bc-4b16-9cf6-c7531c749a68 is being set with open permissions: ugo+rw Apr 29 06:48:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0229c44f-c0fc-4af4-abf2-949fb072df79 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.1fad562c-19bc-4b16-9cf6-c7531c749a68 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:33 devstack sudo[92994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.1fad562c-19bc-4b16-9cf6-c7531c749a68 Apr 29 06:48:33 devstack sudo[92994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:33 devstack sudo[92994]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0229c44f-c0fc-4af4-abf2-949fb072df79 tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.1fad562c-19bc-4b16-9cf6-c7531c749a68" returned: 0 in 0.584s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0229c44f-c0fc-4af4-abf2-949fb072df79 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:33 devstack sudo[92997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.info Apr 29 06:48:33 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:34 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0229c44f-c0fc-4af4-abf2-949fb072df79 tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.info" returned: 0 in 0.621s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:34 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-0229c44f-c0fc-4af4-abf2-949fb072df79 tempest-VolumeDependencyTests-1173106783 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.info is being set with open permissions: ugo+rw Apr 29 06:48:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0229c44f-c0fc-4af4-abf2-949fb072df79 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:34 devstack sudo[93000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.info Apr 29 06:48:34 devstack sudo[93000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:34 devstack sudo[93000]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0229c44f-c0fc-4af4-abf2-949fb072df79 tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.info" returned: 0 in 0.577s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-0229c44f-c0fc-4af4-abf2-949fb072df79 tempest-VolumeDependencyTests-1173106783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.913s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:34 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-0229c44f-c0fc-4af4-abf2-949fb072df79 tempest-VolumeDependencyTests-1173106783 None] Create snapshot completed successfully Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:SELECT=51,cinder:UPDATE=78,cinder:INSERT=19,cinder:DELETE=6 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Flow 'volume_create_manager' (990befd4-3b54-4250-878d-e0dadf96a5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b49d98-5e9d-48f7-ba18-86ba72c10ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b49d98-5e9d-48f7-ba18-86ba72c10ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1610033328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503feebc-67b8-4831-9c66-ea3776b920e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc68427a4fd401bae4b64c1cb454d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1fad562c-19bc-4b16-9cf6-c7531c749a68,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:48:35Z,use_quota=True,user_id='dee569291b7b4c0797a3eeee6f1b8249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b37bd231-196d-475e-b839-29eb0f5901ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b37bd231-196d-475e-b839-29eb0f5901ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89803084-3121-4695-aec7-ba368c10751d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89803084-3121-4695-aec7-ba368c10751d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '503feebc-67b8-4831-9c66-ea3776b920e1', 'volume_name': 'volume-503feebc-67b8-4831-9c66-ea3776b920e1', 'volume_size': 1, 'snapshot_id': '1fad562c-19bc-4b16-9cf6-c7531c749a68'}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c78c86b-85ec-4738-bac8-3e18e407aec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c78c86b-85ec-4738-bac8-3e18e407aec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c27eab53-0d0f-418f-88bc-82e83ce470a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:35 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Volume 503feebc-67b8-4831-9c66-ea3776b920e1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-503feebc-67b8-4831-9c66-ea3776b920e1', 'volume_size': 1, 'snapshot_id': '1fad562c-19bc-4b16-9cf6-c7531c749a68'} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "cinder-quobyte-1fad562c-19bc-4b16-9cf6-c7531c749a68-503feebc-67b8-4831-9c66-ea3776b920e1" by "_create_volume_from_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-quobyte-1fad562c-19bc-4b16-9cf6-c7531c749a68-503feebc-67b8-4831-9c66-ea3776b920e1" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Creating volume 503feebc-67b8-4831-9c66-ea3776b920e1 from snapshot 1fad562c-19bc-4b16-9cf6-c7531c749a68 {{(pid=84195) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "cinder-quobyte-503feebc-67b8-4831-9c66-ea3776b920e1" by "_copy_volume_from_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-quobyte-503feebc-67b8-4831-9c66-ea3776b920e1" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] snapshot: 1fad562c-19bc-4b16-9cf6-c7531c749a68, volume: 503feebc-67b8-4831-9c66-ea3776b920e1, {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40fc522-cbc8-4d49-81ad-fdabbeb4afec]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:48:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.1fad562c-19bc-4b16-9cf6-c7531c749a68 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:35 devstack sudo[93005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.1fad562c-19bc-4b16-9cf6-c7531c749a68 Apr 29 06:48:35 devstack sudo[93005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:36 devstack sudo[93005]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.1fad562c-19bc-4b16-9cf6-c7531c749a68" returned: 0 in 0.707s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d29cf860-873f-4f47-a25e-b8202921be40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:48:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40 {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 06:48:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Creating direct copy from snapshot {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 06:48:36 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d288a9-3f18-499c-8217-1cbb5e88add8]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:48:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:36 devstack sudo[93011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40 Apr 29 06:48:36 devstack sudo[93011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:36 devstack cinder-volume[84195]: DEBUG oslo_service.periodic_task [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84195) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 06:48:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:48:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:48:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:36 devstack sudo[93014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:48:36 devstack sudo[93014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:37 devstack sudo[93011]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40" returned: 0 in 0.689s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:37 devstack cinder-volume[84195]: DEBUG cinder.utils [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Path /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-503feebc-67b8-4831-9c66-ea3776b920e1 not found in is_blk_device check {{(pid=84195) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 06:48:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-503feebc-67b8-4831-9c66-ea3776b920e1 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:37 devstack sudo[93020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-503feebc-67b8-4831-9c66-ea3776b920e1 Apr 29 06:48:37 devstack sudo[93020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:37 devstack sudo[93014]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.605s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:37 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:48:41 devstack sudo[93020]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-503feebc-67b8-4831-9c66-ea3776b920e1" returned: 0 in 4.421s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:41 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfa7b40-9844-4dcd-b852-9c9f30efda33]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:48:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:41 devstack sudo[93033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40 Apr 29 06:48:41 devstack sudo[93033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:42 devstack sudo[93033]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40" returned: 0 in 0.846s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:42 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Image conversion details: src /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40, size 1024.00 MB, duration 4.42 sec, destination /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-503feebc-67b8-4831-9c66-ea3776b920e1 {{(pid=84195) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 06:48:42 devstack cinder-volume[84195]: INFO cinder.image.image_utils [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Converted 1024.00 MB image at 231.59 MB/s Apr 29 06:48:42 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-503feebc-67b8-4831-9c66-ea3776b920e1 is being set with open permissions: ugo+rw Apr 29 06:48:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-503feebc-67b8-4831-9c66-ea3776b920e1 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:42 devstack sudo[93038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-503feebc-67b8-4831-9c66-ea3776b920e1 Apr 29 06:48:42 devstack sudo[93038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:42 devstack sudo[93038]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-503feebc-67b8-4831-9c66-ea3776b920e1" returned: 0 in 0.581s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:42 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-quobyte-503feebc-67b8-4831-9c66-ea3776b920e1" released by "_copy_volume_from_snapshot" :: held 7.329s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:48:42 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-quobyte-1fad562c-19bc-4b16-9cf6-c7531c749a68-503feebc-67b8-4831-9c66-ea3776b920e1" released by "_create_volume_from_snapshot" :: held 7.356s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:48:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.371s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c27eab53-0d0f-418f-88bc-82e83ce470a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-503feebc-67b8-4831-9c66-ea3776b920e1', 'volume_size': 1, 'snapshot_id': '1fad562c-19bc-4b16-9cf6-c7531c749a68'}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (733657a8-92c0-4986-95b5-7a1fdb99f999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:43 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Volume volume-503feebc-67b8-4831-9c66-ea3776b920e1 (503feebc-67b8-4831-9c66-ea3776b920e1): created successfully Apr 29 06:48:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (733657a8-92c0-4986-95b5-7a1fdb99f999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:43 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Flow 'volume_create_manager' (990befd4-3b54-4250-878d-e0dadf96a5d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:48:43 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-2c0a1335-f099-441e-b01c-9c858e424451 tempest-VolumeDependencyTests-1173106783 None] Created volume successfully. Apr 29 06:48:44 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-02c2a629-9056-466c-86a0-4a6ee747c06c tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "cinder-1fad562c-19bc-4b16-9cf6-c7531c749a68-delete_snapshot" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:48:44 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-02c2a629-9056-466c-86a0-4a6ee747c06c tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-1fad562c-19bc-4b16-9cf6-c7531c749a68-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:48:44 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-02c2a629-9056-466c-86a0-4a6ee747c06c tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "cinder-quobyte-d29cf860-873f-4f47-a25e-b8202921be40" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:48:44 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-02c2a629-9056-466c-86a0-4a6ee747c06c tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-quobyte-d29cf860-873f-4f47-a25e-b8202921be40" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:48:44 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-02c2a629-9056-466c-86a0-4a6ee747c06c tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "cinder-quobyte-1fad562c-19bc-4b16-9cf6-c7531c749a68" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:48:44 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-02c2a629-9056-466c-86a0-4a6ee747c06c tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-quobyte-1fad562c-19bc-4b16-9cf6-c7531c749a68" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:48:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-02c2a629-9056-466c-86a0-4a6ee747c06c tempest-VolumeDependencyTests-1173106783 None] Deleting offline snapshot 1fad562c-19bc-4b16-9cf6-c7531c749a68 of volume d29cf860-873f-4f47-a25e-b8202921be40 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:48:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-02c2a629-9056-466c-86a0-4a6ee747c06c tempest-VolumeDependencyTests-1173106783 None] snapshot_file for this snap is: volume-d29cf860-873f-4f47-a25e-b8202921be40.1fad562c-19bc-4b16-9cf6-c7531c749a68 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:48:44 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe31321b-ee12-44aa-9b64-5f5d6354ce30]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:48:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-02c2a629-9056-466c-86a0-4a6ee747c06c tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.1fad562c-19bc-4b16-9cf6-c7531c749a68 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:44 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.1fad562c-19bc-4b16-9cf6-c7531c749a68 Apr 29 06:48:44 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:44 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-02c2a629-9056-466c-86a0-4a6ee747c06c tempest-VolumeDependencyTests-1173106783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.1fad562c-19bc-4b16-9cf6-c7531c749a68" returned: 0 in 0.690s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-02c2a629-9056-466c-86a0-4a6ee747c06c tempest-VolumeDependencyTests-1173106783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d29cf860-873f-4f47-a25e-b8202921be40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:48:44 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c8249f-f5d0-453f-b66a-381e351d26ea]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:48:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-02c2a629-9056-466c-86a0-4a6ee747c06c tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:45 devstack sudo[93046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40 Apr 29 06:48:45 devstack sudo[93046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:45 devstack sudo[93046]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-02c2a629-9056-466c-86a0-4a6ee747c06c tempest-VolumeDependencyTests-1173106783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40" returned: 0 in 0.702s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-02c2a629-9056-466c-86a0-4a6ee747c06c tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.1fad562c-19bc-4b16-9cf6-c7531c749a68 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:45 devstack sudo[93051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.1fad562c-19bc-4b16-9cf6-c7531c749a68 Apr 29 06:48:45 devstack sudo[93051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:46 devstack sudo[93051]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-02c2a629-9056-466c-86a0-4a6ee747c06c tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.1fad562c-19bc-4b16-9cf6-c7531c749a68" returned: 0 in 0.663s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-02c2a629-9056-466c-86a0-4a6ee747c06c tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.1fad562c-19bc-4b16-9cf6-c7531c749a68 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:46 devstack sudo[93056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.1fad562c-19bc-4b16-9cf6-c7531c749a68 Apr 29 06:48:46 devstack sudo[93056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:46 devstack sudo[93056]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-02c2a629-9056-466c-86a0-4a6ee747c06c tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40.1fad562c-19bc-4b16-9cf6-c7531c749a68" returned: 0 in 0.586s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-02c2a629-9056-466c-86a0-4a6ee747c06c tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-quobyte-1fad562c-19bc-4b16-9cf6-c7531c749a68" released by "_delete_snapshot" :: held 2.733s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:48:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-02c2a629-9056-466c-86a0-4a6ee747c06c tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-quobyte-d29cf860-873f-4f47-a25e-b8202921be40" released by "delete_snapshot" :: held 2.752s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:48:46 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-02c2a629-9056-466c-86a0-4a6ee747c06c tempest-VolumeDependencyTests-1173106783 None] Created reservations ['f44c5254-c13f-4f7b-ba5c-518837453443', 'aec14fbc-b9c5-4ca2-b226-a34168451a37', '7e18cdba-c2a0-43a5-84fc-11356c0d642f', '050bb522-c2d8-4f1c-a048-848084edfb8d'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:48:47 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-02c2a629-9056-466c-86a0-4a6ee747c06c tempest-VolumeDependencyTests-1173106783 None] Delete snapshot completed successfully. Apr 29 06:48:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-02c2a629-9056-466c-86a0-4a6ee747c06c tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-1fad562c-19bc-4b16-9cf6-c7531c749a68-delete_snapshot" released by "delete_snapshot" :: held 2.872s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:48:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8f563d08-3f5e-4823-b310-0ced78217330 tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "cinder-d29cf860-873f-4f47-a25e-b8202921be40-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:48:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8f563d08-3f5e-4823-b310-0ced78217330 tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-d29cf860-873f-4f47-a25e-b8202921be40-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:48:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8f563d08-3f5e-4823-b310-0ced78217330 tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "cinder-quobyte-d29cf860-873f-4f47-a25e-b8202921be40" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:48:47 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8f563d08-3f5e-4823-b310-0ced78217330 tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-quobyte-d29cf860-873f-4f47-a25e-b8202921be40" acquired by "delete_volume" :: waited 0.015s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:48:47 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[df061e76-b4a3-4d76-9d1a-b5d30419bfff]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:48:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8f563d08-3f5e-4823-b310-0ced78217330 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:47 devstack sudo[93061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40 Apr 29 06:48:47 devstack sudo[93061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:48 devstack sudo[93061]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8f563d08-3f5e-4823-b310-0ced78217330 tempest-VolumeDependencyTests-1173106783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40" returned: 0 in 0.700s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8f563d08-3f5e-4823-b310-0ced78217330 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:48 devstack sudo[93066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40 Apr 29 06:48:48 devstack sudo[93066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:48 devstack sudo[93066]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8f563d08-3f5e-4823-b310-0ced78217330 tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d29cf860-873f-4f47-a25e-b8202921be40" returned: 0 in 0.592s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:48 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8f563d08-3f5e-4823-b310-0ced78217330 tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-quobyte-d29cf860-873f-4f47-a25e-b8202921be40" released by "delete_volume" :: held 1.348s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:48:48 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-8f563d08-3f5e-4823-b310-0ced78217330 tempest-VolumeDependencyTests-1173106783 None] Created reservations ['5d23c539-bfcf-4776-b8a6-78f643fc89f7', '07616559-ea55-49ab-8a83-ba48d0118a3b', '0f91da89-205d-4009-a01a-e25fc7bb462e', 'bc08baf3-7670-4c15-9792-86f8dad936ee'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:48:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8f563d08-3f5e-4823-b310-0ced78217330 tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8f563d08-3f5e-4823-b310-0ced78217330 tempest-VolumeDependencyTests-1173106783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:48 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8f563d08-3f5e-4823-b310-0ced78217330 tempest-VolumeDependencyTests-1173106783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:48:48 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8f563d08-3f5e-4823-b310-0ced78217330 tempest-VolumeDependencyTests-1173106783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:48:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8f563d08-3f5e-4823-b310-0ced78217330 tempest-VolumeDependencyTests-1173106783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8f563d08-3f5e-4823-b310-0ced78217330 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:48 devstack sudo[93069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:48:48 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:49 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8f563d08-3f5e-4823-b310-0ced78217330 tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.594s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:49 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-8f563d08-3f5e-4823-b310-0ced78217330 tempest-VolumeDependencyTests-1173106783 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:48:49 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-8f563d08-3f5e-4823-b310-0ced78217330 tempest-VolumeDependencyTests-1173106783 None] Deleted volume successfully. Apr 29 06:48:49 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8f563d08-3f5e-4823-b310-0ced78217330 tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-d29cf860-873f-4f47-a25e-b8202921be40-delete_volume" released by "delete_volume" :: held 2.124s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:48:49 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:48:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Flow 'volume_create_manager' (c94206c4-9ea0-4c09-a618-1019d7fe214b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:48:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7377dffb-2012-406a-94a6-a2e58e91a0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7377dffb-2012-406a-94a6-a2e58e91a0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-773508645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db2ec427-a609-4404-9d5b-3c645f4ff211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc68427a4fd401bae4b64c1cb454d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:48:50Z,use_quota=True,user_id='dee569291b7b4c0797a3eeee6f1b8249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc750da4-5986-4809-8680-8b237fd9177e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc750da4-5986-4809-8680-8b237fd9177e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d75388-da9b-48b6-acc3-153c1bb05a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d75388-da9b-48b6-acc3-153c1bb05a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db2ec427-a609-4404-9d5b-3c645f4ff211', 'volume_name': 'volume-db2ec427-a609-4404-9d5b-3c645f4ff211', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca148dee-61f9-4168-b7af-fb76f8a1b697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca148dee-61f9-4168-b7af-fb76f8a1b697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8074e802-1a72-4276-b3a9-5bf39acdc821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:49 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Volume db2ec427-a609-4404-9d5b-3c645f4ff211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db2ec427-a609-4404-9d5b-3c645f4ff211', 'volume_size': 1} Apr 29 06:48:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-773508645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db2ec427-a609-4404-9d5b-3c645f4ff211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc68427a4fd401bae4b64c1cb454d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:48:50Z,use_quota=True,user_id='dee569291b7b4c0797a3eeee6f1b8249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:48:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Creating volume db2ec427-a609-4404-9d5b-3c645f4ff211 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:48:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:48:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:48:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:48:49 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:48:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:49 devstack sudo[93072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211 1073741824 Apr 29 06:48:49 devstack sudo[93072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:50 devstack sudo[93072]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211 1073741824" returned: 0 in 0.748s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:50 devstack sudo[93077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211 Apr 29 06:48:50 devstack sudo[93077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:51 devstack sudo[93077]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211" returned: 0 in 0.593s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:51 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:48:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:51 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8074e802-1a72-4276-b3a9-5bf39acdc821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db2ec427-a609-4404-9d5b-3c645f4ff211', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:51 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38268b58-9ba3-4e94-bf3d-c385ac1aa399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:51 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Volume volume-db2ec427-a609-4404-9d5b-3c645f4ff211 (db2ec427-a609-4404-9d5b-3c645f4ff211): created successfully Apr 29 06:48:51 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38268b58-9ba3-4e94-bf3d-c385ac1aa399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:51 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Flow 'volume_create_manager' (c94206c4-9ea0-4c09-a618-1019d7fe214b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:48:51 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-85bde1ef-d527-4267-8762-1a29da67a97c tempest-VolumeDependencyTests-1173106783 None] Created volume successfully. Apr 29 06:48:52 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:48:52 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Flow 'volume_create_manager' (e6029667-9add-45a4-bc2a-4a224082e2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:48:52 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5e608a-1d15-4e41-9cf6-cb535ea33cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:52 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5e608a-1d15-4e41-9cf6-cb535ea33cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1961087223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2d3852-8d65-4f29-a9ab-134c4987544f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc68427a4fd401bae4b64c1cb454d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=db2ec427-a609-4404-9d5b-3c645f4ff211,status='creating',terminated_at=None,updated_at=2026-04-29T04:48:52Z,use_quota=True,user_id='dee569291b7b4c0797a3eeee6f1b8249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:52 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2185c710-b796-4703-8aa0-e32bbfc14c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:52 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2185c710-b796-4703-8aa0-e32bbfc14c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:52 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04059f3d-5469-4e23-b608-92133bfc7776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:52 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04059f3d-5469-4e23-b608-92133bfc7776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5e2d3852-8d65-4f29-a9ab-134c4987544f', 'volume_name': 'volume-5e2d3852-8d65-4f29-a9ab-134c4987544f', 'volume_size': 1, 'source_volid': 'db2ec427-a609-4404-9d5b-3c645f4ff211', 'source_volstatus': 'available'}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:52 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539d63db-ee95-4e8a-a3ed-402007244598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:52 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539d63db-ee95-4e8a-a3ed-402007244598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:48:52 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93813b61-cd99-47f6-85ca-d78fe41bad4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:48:52 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Volume 5e2d3852-8d65-4f29-a9ab-134c4987544f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5e2d3852-8d65-4f29-a9ab-134c4987544f', 'volume_size': 1, 'source_volid': 'db2ec427-a609-4404-9d5b-3c645f4ff211', 'source_volstatus': 'available'} Apr 29 06:48:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:52 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Cloning volume db2ec427-a609-4404-9d5b-3c645f4ff211 to volume 5e2d3852-8d65-4f29-a9ab-134c4987544f Apr 29 06:48:52 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Creating offline snapshot 984093b4-0573-4ec1-bb5f-bc6b221e64c4 of volume db2ec427-a609-4404-9d5b-3c645f4ff211 {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:48:52 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[c642dcba-47e1-4d86-9406-ff0c3355c6b1]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:48:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:52 devstack sudo[93080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211 Apr 29 06:48:52 devstack sudo[93080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:53 devstack sudo[93080]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211" returned: 0 in 0.714s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.984093b4-0573-4ec1-bb5f-bc6b221e64c4 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:53 devstack sudo[93085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.984093b4-0573-4ec1-bb5f-bc6b221e64c4 1G Apr 29 06:48:53 devstack sudo[93085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:53 devstack sudo[93085]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.984093b4-0573-4ec1-bb5f-bc6b221e64c4 1G" returned: 0 in 0.754s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db2ec427-a609-4404-9d5b-3c645f4ff211 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.984093b4-0573-4ec1-bb5f-bc6b221e64c4 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:53 devstack sudo[93090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db2ec427-a609-4404-9d5b-3c645f4ff211 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.984093b4-0573-4ec1-bb5f-bc6b221e64c4 Apr 29 06:48:53 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:54 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db2ec427-a609-4404-9d5b-3c645f4ff211 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.984093b4-0573-4ec1-bb5f-bc6b221e64c4" returned: 0 in 0.622s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:54 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.984093b4-0573-4ec1-bb5f-bc6b221e64c4 is being set with open permissions: ugo+rw Apr 29 06:48:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.984093b4-0573-4ec1-bb5f-bc6b221e64c4 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:54 devstack sudo[93095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.984093b4-0573-4ec1-bb5f-bc6b221e64c4 Apr 29 06:48:54 devstack sudo[93095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:55 devstack sudo[93095]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.984093b4-0573-4ec1-bb5f-bc6b221e64c4" returned: 0 in 0.586s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:55 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:SELECT=77,cinder:INSERT=22,cinder:UPDATE=98,cinder:DELETE=11 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:48:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:55 devstack sudo[93098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.info Apr 29 06:48:55 devstack sudo[93098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:55 devstack sudo[93098]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.info" returned: 0 in 0.593s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:55 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.info is being set with open permissions: ugo+rw Apr 29 06:48:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:55 devstack sudo[93101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.info Apr 29 06:48:55 devstack sudo[93101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:56 devstack sudo[93101]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.info" returned: 0 in 0.582s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:56 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "cinder-quobyte-5e2d3852-8d65-4f29-a9ab-134c4987544f" by "_copy_volume_from_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:48:56 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-quobyte-5e2d3852-8d65-4f29-a9ab-134c4987544f" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:48:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] snapshot: 984093b4-0573-4ec1-bb5f-bc6b221e64c4, volume: 5e2d3852-8d65-4f29-a9ab-134c4987544f, {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 06:48:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:48:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:48:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:48:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:48:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:48:56 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bd7220-e50c-43f4-bae3-f74c8b137f9d]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:48:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.984093b4-0573-4ec1-bb5f-bc6b221e64c4 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:56 devstack sudo[93104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.984093b4-0573-4ec1-bb5f-bc6b221e64c4 Apr 29 06:48:56 devstack sudo[93104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:57 devstack sudo[93104]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.984093b4-0573-4ec1-bb5f-bc6b221e64c4" returned: 0 in 0.697s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:57 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db2ec427-a609-4404-9d5b-3c645f4ff211(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:48:57 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211 {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 06:48:57 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Creating direct copy from snapshot {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 06:48:57 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a2895a-fc33-4b6e-8229-5a9cf2738a2f]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:48:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:57 devstack sudo[93110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211 Apr 29 06:48:57 devstack sudo[93110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:48:57 devstack sudo[93110]: pam_unix(sudo:session): session closed for user root Apr 29 06:48:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211" returned: 0 in 0.694s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:48:57 devstack cinder-volume[84195]: DEBUG cinder.utils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Path /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5e2d3852-8d65-4f29-a9ab-134c4987544f not found in is_blk_device check {{(pid=84195) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 06:48:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5e2d3852-8d65-4f29-a9ab-134c4987544f {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:48:57 devstack sudo[93115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5e2d3852-8d65-4f29-a9ab-134c4987544f Apr 29 06:48:57 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:02 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5e2d3852-8d65-4f29-a9ab-134c4987544f" returned: 0 in 4.431s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:02 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2dcddda-d109-4052-9d4b-55b6e010da02]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:49:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:02 devstack sudo[93128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211 Apr 29 06:49:02 devstack sudo[93128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:03 devstack sudo[93128]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211" returned: 0 in 0.855s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:03 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Image conversion details: src /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211, size 1024.00 MB, duration 4.43 sec, destination /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5e2d3852-8d65-4f29-a9ab-134c4987544f {{(pid=84195) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 06:49:03 devstack cinder-volume[84195]: INFO cinder.image.image_utils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Converted 1024.00 MB image at 231.03 MB/s Apr 29 06:49:03 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5e2d3852-8d65-4f29-a9ab-134c4987544f is being set with open permissions: ugo+rw Apr 29 06:49:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5e2d3852-8d65-4f29-a9ab-134c4987544f {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:03 devstack sudo[93133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5e2d3852-8d65-4f29-a9ab-134c4987544f Apr 29 06:49:03 devstack sudo[93133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:03 devstack sudo[93133]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5e2d3852-8d65-4f29-a9ab-134c4987544f" returned: 0 in 0.611s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:03 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-quobyte-5e2d3852-8d65-4f29-a9ab-134c4987544f" released by "_copy_volume_from_snapshot" :: held 7.365s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:49:03 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "cinder-quobyte-984093b4-0573-4ec1-bb5f-bc6b221e64c4" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:49:03 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-quobyte-984093b4-0573-4ec1-bb5f-bc6b221e64c4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:49:03 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Deleting offline snapshot 984093b4-0573-4ec1-bb5f-bc6b221e64c4 of volume db2ec427-a609-4404-9d5b-3c645f4ff211 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:49:03 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] snapshot_file for this snap is: volume-db2ec427-a609-4404-9d5b-3c645f4ff211.984093b4-0573-4ec1-bb5f-bc6b221e64c4 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:49:03 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a59d53-a796-403d-ac54-6d8c18399a06]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:49:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.984093b4-0573-4ec1-bb5f-bc6b221e64c4 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:03 devstack sudo[93136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.984093b4-0573-4ec1-bb5f-bc6b221e64c4 Apr 29 06:49:03 devstack sudo[93136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:04 devstack sudo[93136]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.984093b4-0573-4ec1-bb5f-bc6b221e64c4" returned: 0 in 0.725s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db2ec427-a609-4404-9d5b-3c645f4ff211(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:49:04 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50b5bbb-564d-4c5d-92a9-9d8b7691c9da]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:49:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:04 devstack sudo[93141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211 Apr 29 06:49:04 devstack sudo[93141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:05 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:SELECT=19,cinder:UPDATE=21,cinder:INSERT=6,cinder:DELETE=1 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:49:05 devstack sudo[93141]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211" returned: 0 in 0.704s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.984093b4-0573-4ec1-bb5f-bc6b221e64c4 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:05 devstack sudo[93146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.984093b4-0573-4ec1-bb5f-bc6b221e64c4 Apr 29 06:49:05 devstack sudo[93146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:05 devstack sudo[93146]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.984093b4-0573-4ec1-bb5f-bc6b221e64c4" returned: 0 in 0.686s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.984093b4-0573-4ec1-bb5f-bc6b221e64c4 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:06 devstack sudo[93151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.984093b4-0573-4ec1-bb5f-bc6b221e64c4 Apr 29 06:49:06 devstack sudo[93151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:06 devstack sudo[93151]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211.984093b4-0573-4ec1-bb5f-bc6b221e64c4" returned: 0 in 0.583s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:06 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-quobyte-984093b4-0573-4ec1-bb5f-bc6b221e64c4" released by "_delete_snapshot" :: held 2.776s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:49:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.158s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93813b61-cd99-47f6-85ca-d78fe41bad4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e2d3852-8d65-4f29-a9ab-134c4987544f', 'volume_size': 1, 'source_volid': 'db2ec427-a609-4404-9d5b-3c645f4ff211', 'source_volstatus': 'available'}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15bfb792-c542-4255-ad7d-da8cf624b5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:06 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Volume volume-5e2d3852-8d65-4f29-a9ab-134c4987544f (5e2d3852-8d65-4f29-a9ab-134c4987544f): created successfully Apr 29 06:49:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15bfb792-c542-4255-ad7d-da8cf624b5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:06 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Flow 'volume_create_manager' (e6029667-9add-45a4-bc2a-4a224082e2df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:49:06 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-1623821e-3a9c-4672-bead-6f77e324c9e4 tempest-VolumeDependencyTests-1173106783 None] Created volume successfully. Apr 29 06:49:07 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93c12dd0-bca0-4c05-aa2f-26ff13423538 tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "cinder-db2ec427-a609-4404-9d5b-3c645f4ff211-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:49:07 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93c12dd0-bca0-4c05-aa2f-26ff13423538 tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-db2ec427-a609-4404-9d5b-3c645f4ff211-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:49:07 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93c12dd0-bca0-4c05-aa2f-26ff13423538 tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "cinder-quobyte-db2ec427-a609-4404-9d5b-3c645f4ff211" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:49:07 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93c12dd0-bca0-4c05-aa2f-26ff13423538 tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-quobyte-db2ec427-a609-4404-9d5b-3c645f4ff211" acquired by "delete_volume" :: waited 0.017s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:49:07 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cbd583-dd6c-4b44-b2ea-bd5bd66dc254]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:49:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93c12dd0-bca0-4c05-aa2f-26ff13423538 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:07 devstack sudo[93155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211 Apr 29 06:49:07 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:08 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93c12dd0-bca0-4c05-aa2f-26ff13423538 tempest-VolumeDependencyTests-1173106783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211" returned: 0 in 0.713s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93c12dd0-bca0-4c05-aa2f-26ff13423538 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:08 devstack sudo[93160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211 Apr 29 06:49:08 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:08 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93c12dd0-bca0-4c05-aa2f-26ff13423538 tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-db2ec427-a609-4404-9d5b-3c645f4ff211" returned: 0 in 0.597s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:08 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93c12dd0-bca0-4c05-aa2f-26ff13423538 tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-quobyte-db2ec427-a609-4404-9d5b-3c645f4ff211" released by "delete_volume" :: held 1.364s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:49:08 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-93c12dd0-bca0-4c05-aa2f-26ff13423538 tempest-VolumeDependencyTests-1173106783 None] Created reservations ['f0948674-b058-48b6-923c-8db189f9fd2b', '73f4ebd8-1501-4dd7-a6c8-48a4d9e4fef1', 'c6809041-82b3-4f46-bc6f-1062c193f27a', 'c8b47378-cc49-4138-a8c3-4b980d752733'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:49:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-93c12dd0-bca0-4c05-aa2f-26ff13423538 tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-93c12dd0-bca0-4c05-aa2f-26ff13423538 tempest-VolumeDependencyTests-1173106783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-93c12dd0-bca0-4c05-aa2f-26ff13423538 tempest-VolumeDependencyTests-1173106783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:49:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-93c12dd0-bca0-4c05-aa2f-26ff13423538 tempest-VolumeDependencyTests-1173106783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:49:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-93c12dd0-bca0-4c05-aa2f-26ff13423538 tempest-VolumeDependencyTests-1173106783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93c12dd0-bca0-4c05-aa2f-26ff13423538 tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:08 devstack sudo[93163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:49:08 devstack sudo[93163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:09 devstack sudo[93163]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93c12dd0-bca0-4c05-aa2f-26ff13423538 tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.598s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:09 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-93c12dd0-bca0-4c05-aa2f-26ff13423538 tempest-VolumeDependencyTests-1173106783 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:49:09 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-93c12dd0-bca0-4c05-aa2f-26ff13423538 tempest-VolumeDependencyTests-1173106783 None] Deleted volume successfully. Apr 29 06:49:09 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93c12dd0-bca0-4c05-aa2f-26ff13423538 tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-db2ec427-a609-4404-9d5b-3c645f4ff211-delete_volume" released by "delete_volume" :: held 2.148s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:49:09 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ad3cbdb0-3ac4-42e3-866c-2d0c67ba5cce tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "cinder-5e2d3852-8d65-4f29-a9ab-134c4987544f-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:49:09 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ad3cbdb0-3ac4-42e3-866c-2d0c67ba5cce tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-5e2d3852-8d65-4f29-a9ab-134c4987544f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:49:09 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ad3cbdb0-3ac4-42e3-866c-2d0c67ba5cce tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "cinder-quobyte-5e2d3852-8d65-4f29-a9ab-134c4987544f" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:49:09 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ad3cbdb0-3ac4-42e3-866c-2d0c67ba5cce tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-quobyte-5e2d3852-8d65-4f29-a9ab-134c4987544f" acquired by "delete_volume" :: waited 0.014s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:49:09 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ed00e8-7232-463c-bc27-af317f100f1f]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:49:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ad3cbdb0-3ac4-42e3-866c-2d0c67ba5cce tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5e2d3852-8d65-4f29-a9ab-134c4987544f {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:09 devstack sudo[93166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5e2d3852-8d65-4f29-a9ab-134c4987544f Apr 29 06:49:09 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:10 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ad3cbdb0-3ac4-42e3-866c-2d0c67ba5cce tempest-VolumeDependencyTests-1173106783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5e2d3852-8d65-4f29-a9ab-134c4987544f" returned: 0 in 0.706s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ad3cbdb0-3ac4-42e3-866c-2d0c67ba5cce tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5e2d3852-8d65-4f29-a9ab-134c4987544f {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:10 devstack sudo[93171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5e2d3852-8d65-4f29-a9ab-134c4987544f Apr 29 06:49:10 devstack sudo[93171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:11 devstack sudo[93171]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ad3cbdb0-3ac4-42e3-866c-2d0c67ba5cce tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5e2d3852-8d65-4f29-a9ab-134c4987544f" returned: 0 in 0.588s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:11 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ad3cbdb0-3ac4-42e3-866c-2d0c67ba5cce tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-quobyte-5e2d3852-8d65-4f29-a9ab-134c4987544f" released by "delete_volume" :: held 1.332s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:49:11 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-ad3cbdb0-3ac4-42e3-866c-2d0c67ba5cce tempest-VolumeDependencyTests-1173106783 None] Created reservations ['fb34c662-1a1c-458e-a47d-a4b9a599a48d', '49ff4444-2279-470b-9abf-abff0dac741f', 'e86b6257-6676-4f85-b456-eaef56c54e6a', 'f070a017-70ff-4022-bcf3-59d1df42ff9e'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:49:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-ad3cbdb0-3ac4-42e3-866c-2d0c67ba5cce tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-ad3cbdb0-3ac4-42e3-866c-2d0c67ba5cce tempest-VolumeDependencyTests-1173106783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:11 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-ad3cbdb0-3ac4-42e3-866c-2d0c67ba5cce tempest-VolumeDependencyTests-1173106783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:49:11 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-ad3cbdb0-3ac4-42e3-866c-2d0c67ba5cce tempest-VolumeDependencyTests-1173106783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:49:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-ad3cbdb0-3ac4-42e3-866c-2d0c67ba5cce tempest-VolumeDependencyTests-1173106783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ad3cbdb0-3ac4-42e3-866c-2d0c67ba5cce tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:11 devstack sudo[93174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:49:11 devstack sudo[93174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:11 devstack sudo[93174]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ad3cbdb0-3ac4-42e3-866c-2d0c67ba5cce tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.590s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:11 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-ad3cbdb0-3ac4-42e3-866c-2d0c67ba5cce tempest-VolumeDependencyTests-1173106783 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:49:11 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-ad3cbdb0-3ac4-42e3-866c-2d0c67ba5cce tempest-VolumeDependencyTests-1173106783 None] Deleted volume successfully. Apr 29 06:49:11 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ad3cbdb0-3ac4-42e3-866c-2d0c67ba5cce tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-5e2d3852-8d65-4f29-a9ab-134c4987544f-delete_volume" released by "delete_volume" :: held 2.106s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:49:11 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-a9889aec-eb6f-477e-912a-29fe9d3c153c tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "cinder-503feebc-67b8-4831-9c66-ea3776b920e1-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:49:11 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-a9889aec-eb6f-477e-912a-29fe9d3c153c tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-503feebc-67b8-4831-9c66-ea3776b920e1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:49:11 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-a9889aec-eb6f-477e-912a-29fe9d3c153c tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "cinder-quobyte-503feebc-67b8-4831-9c66-ea3776b920e1" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:49:11 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-a9889aec-eb6f-477e-912a-29fe9d3c153c tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-quobyte-503feebc-67b8-4831-9c66-ea3776b920e1" acquired by "delete_volume" :: waited 0.018s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:49:12 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[0623e237-3fea-402e-915f-227f8a7320ea]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:49:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a9889aec-eb6f-477e-912a-29fe9d3c153c tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-503feebc-67b8-4831-9c66-ea3776b920e1 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:12 devstack sudo[93177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-503feebc-67b8-4831-9c66-ea3776b920e1 Apr 29 06:49:12 devstack sudo[93177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:12 devstack sudo[93177]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a9889aec-eb6f-477e-912a-29fe9d3c153c tempest-VolumeDependencyTests-1173106783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-503feebc-67b8-4831-9c66-ea3776b920e1" returned: 0 in 0.729s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a9889aec-eb6f-477e-912a-29fe9d3c153c tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-503feebc-67b8-4831-9c66-ea3776b920e1 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:12 devstack sudo[93182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-503feebc-67b8-4831-9c66-ea3776b920e1 Apr 29 06:49:12 devstack sudo[93182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:13 devstack sudo[93182]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a9889aec-eb6f-477e-912a-29fe9d3c153c tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-503feebc-67b8-4831-9c66-ea3776b920e1" returned: 0 in 0.624s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:13 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-a9889aec-eb6f-477e-912a-29fe9d3c153c tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-quobyte-503feebc-67b8-4831-9c66-ea3776b920e1" released by "delete_volume" :: held 1.395s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:49:13 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-a9889aec-eb6f-477e-912a-29fe9d3c153c tempest-VolumeDependencyTests-1173106783 None] Created reservations ['2005f851-4b7c-40b2-a300-e3d1088e31d9', '1bf39143-deee-48b9-bc0c-a4a4cc3ade9c', '3ec4ee77-b6ca-4edd-9d62-d648d7d05c52', 'bb4c200e-b638-4067-9195-4e8ce44b66a9'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:49:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a9889aec-eb6f-477e-912a-29fe9d3c153c tempest-VolumeDependencyTests-1173106783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a9889aec-eb6f-477e-912a-29fe9d3c153c tempest-VolumeDependencyTests-1173106783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:13 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-a9889aec-eb6f-477e-912a-29fe9d3c153c tempest-VolumeDependencyTests-1173106783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:49:13 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-a9889aec-eb6f-477e-912a-29fe9d3c153c tempest-VolumeDependencyTests-1173106783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:49:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-a9889aec-eb6f-477e-912a-29fe9d3c153c tempest-VolumeDependencyTests-1173106783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a9889aec-eb6f-477e-912a-29fe9d3c153c tempest-VolumeDependencyTests-1173106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:13 devstack sudo[93185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:49:13 devstack sudo[93185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:14 devstack sudo[93185]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-a9889aec-eb6f-477e-912a-29fe9d3c153c tempest-VolumeDependencyTests-1173106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.637s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:14 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-a9889aec-eb6f-477e-912a-29fe9d3c153c tempest-VolumeDependencyTests-1173106783 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:49:14 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-a9889aec-eb6f-477e-912a-29fe9d3c153c tempest-VolumeDependencyTests-1173106783 None] Deleted volume successfully. Apr 29 06:49:14 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-a9889aec-eb6f-477e-912a-29fe9d3c153c tempest-VolumeDependencyTests-1173106783 None] Lock "cinder-503feebc-67b8-4831-9c66-ea3776b920e1-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:49:24 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:49:24 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Flow 'volume_create_manager' (07802b24-25b4-4277-943a-9f57f006536a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:49:24 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b11296-af1c-4d27-ab86-d21d5beca33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:24 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b11296-af1c-4d27-ab86-d21d5beca33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-641583763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=879bbbc8-d489-4f93-a3a9-60d3a9a025d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456e686489774983ba81291bb9633668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:25Z,use_quota=True,user_id='d50cb45b2d59452fb03a254f1fe1160f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:24 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b0abe7-0516-4e5b-8a9c-474c31fedf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:24 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b0abe7-0516-4e5b-8a9c-474c31fedf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:24 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc6e676-afb5-4090-ae85-29a383cb0db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:24 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc6e676-afb5-4090-ae85-29a383cb0db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '879bbbc8-d489-4f93-a3a9-60d3a9a025d3', 'volume_name': 'volume-879bbbc8-d489-4f93-a3a9-60d3a9a025d3', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:24 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad345d2-3a91-46f0-a6ed-50eadb6de885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:24 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad345d2-3a91-46f0-a6ed-50eadb6de885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:24 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9d3247-f53f-4286-81ee-5bb905162716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:24 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Volume 879bbbc8-d489-4f93-a3a9-60d3a9a025d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-879bbbc8-d489-4f93-a3a9-60d3a9a025d3', 'volume_size': 1} Apr 29 06:49:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:24 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-641583763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=879bbbc8-d489-4f93-a3a9-60d3a9a025d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456e686489774983ba81291bb9633668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:25Z,use_quota=True,user_id='d50cb45b2d59452fb03a254f1fe1160f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:49:24 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Creating volume 879bbbc8-d489-4f93-a3a9-60d3a9a025d3 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:49:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:24 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:49:25 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-879bbbc8-d489-4f93-a3a9-60d3a9a025d3 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:25 devstack sudo[93229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-879bbbc8-d489-4f93-a3a9-60d3a9a025d3 1073741824 Apr 29 06:49:25 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Flow 'volume_create_manager' (9f3a243c-79f7-4355-a7e9-15907ef3b776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (087dff91-a93d-44cf-8f5b-1404e7e67f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (087dff91-a93d-44cf-8f5b-1404e7e67f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1640429893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54128a7b-6c6f-40c6-8f74-2834dc76864f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace88f2823a14804b1907c40d5824803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:25Z,use_quota=True,user_id='571613088c0d4fe6b2c336497496a0fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e24282-7df1-47a0-add7-9b1d7f6e025c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e24282-7df1-47a0-add7-9b1d7f6e025c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (744b5183-7fcf-4cc1-9a71-fe2c3f633c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (744b5183-7fcf-4cc1-9a71-fe2c3f633c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54128a7b-6c6f-40c6-8f74-2834dc76864f', 'volume_name': 'volume-54128a7b-6c6f-40c6-8f74-2834dc76864f', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a4e0a74-8310-43a2-be14-e653408735f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a4e0a74-8310-43a2-be14-e653408735f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3bd485c-fd85-4b9b-a0ad-bb9267b47742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:25 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Volume 54128a7b-6c6f-40c6-8f74-2834dc76864f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54128a7b-6c6f-40c6-8f74-2834dc76864f', 'volume_size': 1} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Flow 'volume_create_manager' (e47f373c-169f-48eb-9987-52f6677ad7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60abf172-74cd-4ce8-b54a-d620219ca38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60abf172-74cd-4ce8-b54a-d620219ca38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1538091366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c133b96-63bd-42c2-8d2f-880a7121d974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb6727e6db924ee09fc3e7750334117d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:25Z,use_quota=True,user_id='9885cfc171114c7a93afbc2c6f918ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df40419f-b1d2-43f5-b37a-259349eacac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df40419f-b1d2-43f5-b37a-259349eacac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbb630d9-293b-4303-9541-ddef09f9d9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbb630d9-293b-4303-9541-ddef09f9d9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c133b96-63bd-42c2-8d2f-880a7121d974', 'volume_name': 'volume-5c133b96-63bd-42c2-8d2f-880a7121d974', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69906a07-9fa7-4de3-a6ee-00ad92fb8303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69906a07-9fa7-4de3-a6ee-00ad92fb8303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f004e58e-4351-4c4a-a3eb-46b3f14956df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:25 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Volume 5c133b96-63bd-42c2-8d2f-880a7121d974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c133b96-63bd-42c2-8d2f-880a7121d974', 'volume_size': 1} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Flow 'volume_create_manager' (6c5224c0-c390-4bd6-8535-7c7af4a70028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b903fd8-2d46-4e65-b2fa-6ddb7451564c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b903fd8-2d46-4e65-b2fa-6ddb7451564c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1501587005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82fba6af-ce86-49c1-8dc1-dc1e40faeb66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456e686489774983ba81291bb9633668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:26Z,use_quota=True,user_id='d50cb45b2d59452fb03a254f1fe1160f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b672279a-2224-4bf4-ab17-5600f7539d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b672279a-2224-4bf4-ab17-5600f7539d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef393c2-9961-4c7f-8669-574049ecf30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef393c2-9961-4c7f-8669-574049ecf30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82fba6af-ce86-49c1-8dc1-dc1e40faeb66', 'volume_name': 'volume-82fba6af-ce86-49c1-8dc1-dc1e40faeb66', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55460b0d-1f91-40b6-848b-49fbf7651999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55460b0d-1f91-40b6-848b-49fbf7651999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c358ad5-e955-4617-aa0d-d19d86bcdf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:25 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Volume 82fba6af-ce86-49c1-8dc1-dc1e40faeb66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82fba6af-ce86-49c1-8dc1-dc1e40faeb66', 'volume_size': 1} Apr 29 06:49:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:26 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:49:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Flow 'volume_create_manager' (54316fb9-4289-49ad-849e-30ab76d8cefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:49:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cfc8bbf-4db4-40fa-bc8e-8225a121bf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:26 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-879bbbc8-d489-4f93-a3a9-60d3a9a025d3 1073741824" returned: 0 in 1.201s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cfc8bbf-4db4-40fa-bc8e-8225a121bf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1069464931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd7d5c2-1653-41e7-9ae0-0b0ef653a9cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456e686489774983ba81291bb9633668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:26Z,use_quota=True,user_id='d50cb45b2d59452fb03a254f1fe1160f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de9406b7-2830-4917-9d2e-e28866cfff42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de9406b7-2830-4917-9d2e-e28866cfff42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fdc4358-e518-4f92-9c40-b70beea9870c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fdc4358-e518-4f92-9c40-b70beea9870c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbd7d5c2-1653-41e7-9ae0-0b0ef653a9cd', 'volume_name': 'volume-cbd7d5c2-1653-41e7-9ae0-0b0ef653a9cd', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec640efd-1018-4dcf-aafb-82b3bfb9a129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec640efd-1018-4dcf-aafb-82b3bfb9a129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (012863af-51c2-47fe-92f1-a0ea9b341b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:26 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Volume cbd7d5c2-1653-41e7-9ae0-0b0ef653a9cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbd7d5c2-1653-41e7-9ae0-0b0ef653a9cd', 'volume_size': 1} Apr 29 06:49:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-879bbbc8-d489-4f93-a3a9-60d3a9a025d3 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:26 devstack sudo[93235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-879bbbc8-d489-4f93-a3a9-60d3a9a025d3 Apr 29 06:49:26 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:26 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:49:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Flow 'volume_create_manager' (e752d1b3-3610-4a5a-8203-f5f1f4110529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:49:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3efabb5-26f6-4ee2-8bc9-c019f14cb58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3efabb5-26f6-4ee2-8bc9-c019f14cb58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1145130680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b904e9-d5b9-4cd6-907b-d4beedd32795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456e686489774983ba81291bb9633668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:27Z,use_quota=True,user_id='d50cb45b2d59452fb03a254f1fe1160f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ffd7cf-2668-4387-a2ba-863f7fa74191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ffd7cf-2668-4387-a2ba-863f7fa74191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18455c1f-40ba-4cd5-9bd6-7eb2d8075e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18455c1f-40ba-4cd5-9bd6-7eb2d8075e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44b904e9-d5b9-4cd6-907b-d4beedd32795', 'volume_name': 'volume-44b904e9-d5b9-4cd6-907b-d4beedd32795', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (304839d6-a304-4d45-ab46-c98262bf3cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (304839d6-a304-4d45-ab46-c98262bf3cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:26 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b6ba0e3-973c-4ae8-ac28-6864647c40df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:26 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Volume 44b904e9-d5b9-4cd6-907b-d4beedd32795: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44b904e9-d5b9-4cd6-907b-d4beedd32795', 'volume_size': 1} Apr 29 06:49:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:27 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-879bbbc8-d489-4f93-a3a9-60d3a9a025d3" returned: 0 in 0.815s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] <== create_volume: return (2115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.117s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.758s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1640429893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54128a7b-6c6f-40c6-8f74-2834dc76864f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace88f2823a14804b1907c40d5824803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:25Z,use_quota=True,user_id='571613088c0d4fe6b2c336497496a0fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Creating volume 54128a7b-6c6f-40c6-8f74-2834dc76864f {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:49:27 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:27 devstack sudo[93273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f 1073741824 Apr 29 06:49:27 devstack sudo[93273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9d3247-f53f-4286-81ee-5bb905162716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-879bbbc8-d489-4f93-a3a9-60d3a9a025d3', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a2fa146-39c0-487a-b412-1def556399eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:27 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Volume volume-879bbbc8-d489-4f93-a3a9-60d3a9a025d3 (879bbbc8-d489-4f93-a3a9-60d3a9a025d3): created successfully Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a2fa146-39c0-487a-b412-1def556399eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Flow 'volume_create_manager' (07802b24-25b4-4277-943a-9f57f006536a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:49:27 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-4a2a83e1-096b-4f5a-aa78-383e04884385 tempest-CreateVolumesFromImageTest-931600814 None] Created volume successfully. Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Flow 'volume_create_manager' (0ca3a7db-0e30-4c0c-843d-9e93ebf1727b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa874f8-ff04-43a0-a6b6-b1e4bcd2dd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa874f8-ff04-43a0-a6b6-b1e4bcd2dd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-200046128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f5575b-9251-4d5f-9c43-5ccd8f884990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456e686489774983ba81291bb9633668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:27Z,use_quota=True,user_id='d50cb45b2d59452fb03a254f1fe1160f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc78ee93-e701-4785-bc88-d61ffb577f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc78ee93-e701-4785-bc88-d61ffb577f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab0f1d8b-fd81-44aa-aa38-5463b5843a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab0f1d8b-fd81-44aa-aa38-5463b5843a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32f5575b-9251-4d5f-9c43-5ccd8f884990', 'volume_name': 'volume-32f5575b-9251-4d5f-9c43-5ccd8f884990', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de78b65a-b5f1-462b-80c0-0e3a3ccd57d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de78b65a-b5f1-462b-80c0-0e3a3ccd57d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a30992f9-e12c-4483-92c4-1be0de74352f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:27 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Volume 32f5575b-9251-4d5f-9c43-5ccd8f884990: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32f5575b-9251-4d5f-9c43-5ccd8f884990', 'volume_size': 1} Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:27 devstack sudo[93273]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f 1073741824" returned: 0 in 0.865s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:28 devstack sudo[93281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f Apr 29 06:49:28 devstack sudo[93281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:28 devstack sudo[93281]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f" returned: 0 in 0.624s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:28 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:49:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.030s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:28 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1538091366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c133b96-63bd-42c2-8d2f-880a7121d974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb6727e6db924ee09fc3e7750334117d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:25Z,use_quota=True,user_id='9885cfc171114c7a93afbc2c6f918ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:49:28 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Creating volume 5c133b96-63bd-42c2-8d2f-880a7121d974 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:49:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:28 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:49:28 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:49:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:28 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:49:28 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:49:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:28 devstack sudo[93284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974 1073741824 Apr 29 06:49:28 devstack sudo[93284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3bd485c-fd85-4b9b-a0ad-bb9267b47742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54128a7b-6c6f-40c6-8f74-2834dc76864f', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b88b120f-488d-4159-8e6b-820d79bb85e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:28 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Volume volume-54128a7b-6c6f-40c6-8f74-2834dc76864f (54128a7b-6c6f-40c6-8f74-2834dc76864f): created successfully Apr 29 06:49:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b88b120f-488d-4159-8e6b-820d79bb85e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:28 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Flow 'volume_create_manager' (9f3a243c-79f7-4355-a7e9-15907ef3b776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:49:28 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-80ba3684-cceb-46bc-922d-d3f950f6c902 tempest-VolumeDependencyTests-709056386 None] Created volume successfully. Apr 29 06:49:29 devstack sudo[93284]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974 1073741824" returned: 0 in 0.857s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:29 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:29 devstack sudo[93290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974 Apr 29 06:49:29 devstack sudo[93290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1a5c6174-5df6-441b-8715-c0e347423887 tempest-VolumeDependencyTests-709056386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:30 devstack sudo[93290]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974" returned: 0 in 0.817s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:30 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:49:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.472s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:30 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1501587005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82fba6af-ce86-49c1-8dc1-dc1e40faeb66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456e686489774983ba81291bb9633668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:26Z,use_quota=True,user_id='d50cb45b2d59452fb03a254f1fe1160f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:49:30 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Creating volume 82fba6af-ce86-49c1-8dc1-dc1e40faeb66 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:49:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:30 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:49:30 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:49:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:30 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:49:30 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:49:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-82fba6af-ce86-49c1-8dc1-dc1e40faeb66 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:30 devstack sudo[93293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-82fba6af-ce86-49c1-8dc1-dc1e40faeb66 1073741824 Apr 29 06:49:30 devstack sudo[93293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:30 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f004e58e-4351-4c4a-a3eb-46b3f14956df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c133b96-63bd-42c2-8d2f-880a7121d974', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:30 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3b9b69-ebf9-420c-837a-b9bc81f150c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:30 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Volume volume-5c133b96-63bd-42c2-8d2f-880a7121d974 (5c133b96-63bd-42c2-8d2f-880a7121d974): created successfully Apr 29 06:49:30 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3b9b69-ebf9-420c-837a-b9bc81f150c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:30 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Flow 'volume_create_manager' (e47f373c-169f-48eb-9987-52f6677ad7d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:49:30 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-57f69587-ef97-4339-90e1-d2a4619466ae tempest-CreateVolumesFromSnapshotTest-1486202130 None] Created volume successfully. Apr 29 06:49:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2ba7d31f-3440-422a-b651-c687c6527ed1 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:31 devstack sudo[93293]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-82fba6af-ce86-49c1-8dc1-dc1e40faeb66 1073741824" returned: 0 in 0.939s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-82fba6af-ce86-49c1-8dc1-dc1e40faeb66 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:31 devstack sudo[93298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-82fba6af-ce86-49c1-8dc1-dc1e40faeb66 Apr 29 06:49:31 devstack sudo[93298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:31 devstack sudo[93298]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-82fba6af-ce86-49c1-8dc1-dc1e40faeb66" returned: 0 in 0.618s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:31 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:49:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.737s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:32 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1069464931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd7d5c2-1653-41e7-9ae0-0b0ef653a9cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456e686489774983ba81291bb9633668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:26Z,use_quota=True,user_id='d50cb45b2d59452fb03a254f1fe1160f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:49:32 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Creating volume cbd7d5c2-1653-41e7-9ae0-0b0ef653a9cd {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:49:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:32 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:49:32 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:49:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:32 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:49:32 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:49:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-cbd7d5c2-1653-41e7-9ae0-0b0ef653a9cd 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:32 devstack sudo[93302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-cbd7d5c2-1653-41e7-9ae0-0b0ef653a9cd 1073741824 Apr 29 06:49:32 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c358ad5-e955-4617-aa0d-d19d86bcdf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82fba6af-ce86-49c1-8dc1-dc1e40faeb66', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:32 devstack sudo[93302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:32 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af73898-2b36-472c-9f8a-aa534c8971ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:32 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Volume volume-82fba6af-ce86-49c1-8dc1-dc1e40faeb66 (82fba6af-ce86-49c1-8dc1-dc1e40faeb66): created successfully Apr 29 06:49:32 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af73898-2b36-472c-9f8a-aa534c8971ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:32 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Flow 'volume_create_manager' (6c5224c0-c390-4bd6-8535-7c7af4a70028) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:49:32 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-5f083f12-39a8-4105-b227-8360031856e7 tempest-CreateVolumesFromImageTest-931600814 None] Created volume successfully. Apr 29 06:49:32 devstack sudo[93302]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-cbd7d5c2-1653-41e7-9ae0-0b0ef653a9cd 1073741824" returned: 0 in 0.863s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-cbd7d5c2-1653-41e7-9ae0-0b0ef653a9cd {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:32 devstack sudo[93314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-cbd7d5c2-1653-41e7-9ae0-0b0ef653a9cd Apr 29 06:49:32 devstack sudo[93314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:33 devstack sudo[93314]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-cbd7d5c2-1653-41e7-9ae0-0b0ef653a9cd" returned: 0 in 0.650s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:33 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:49:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.599s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:33 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1145130680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b904e9-d5b9-4cd6-907b-d4beedd32795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456e686489774983ba81291bb9633668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:27Z,use_quota=True,user_id='d50cb45b2d59452fb03a254f1fe1160f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:49:33 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Creating volume 44b904e9-d5b9-4cd6-907b-d4beedd32795 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:49:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:33 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:49:33 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:49:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:33 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:49:33 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:49:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-44b904e9-d5b9-4cd6-907b-d4beedd32795 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:33 devstack sudo[93317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-44b904e9-d5b9-4cd6-907b-d4beedd32795 1073741824 Apr 29 06:49:33 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:33 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (012863af-51c2-47fe-92f1-a0ea9b341b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbd7d5c2-1653-41e7-9ae0-0b0ef653a9cd', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:33 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c480df-3d78-49da-884d-940828b5d661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:33 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Volume volume-cbd7d5c2-1653-41e7-9ae0-0b0ef653a9cd (cbd7d5c2-1653-41e7-9ae0-0b0ef653a9cd): created successfully Apr 29 06:49:33 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c480df-3d78-49da-884d-940828b5d661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:33 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Flow 'volume_create_manager' (54316fb9-4289-49ad-849e-30ab76d8cefa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:49:33 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-39a5a036-79b4-4ce0-9f44-b133499a659f tempest-CreateVolumesFromImageTest-931600814 None] Created volume successfully. Apr 29 06:49:34 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-44b904e9-d5b9-4cd6-907b-d4beedd32795 1073741824" returned: 0 in 0.833s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-44b904e9-d5b9-4cd6-907b-d4beedd32795 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:34 devstack sudo[93323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-44b904e9-d5b9-4cd6-907b-d4beedd32795 Apr 29 06:49:34 devstack sudo[93323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:35 devstack sudo[93323]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-44b904e9-d5b9-4cd6-907b-d4beedd32795" returned: 0 in 0.619s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:49:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.714s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-200046128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f5575b-9251-4d5f-9c43-5ccd8f884990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456e686489774983ba81291bb9633668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:27Z,use_quota=True,user_id='d50cb45b2d59452fb03a254f1fe1160f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:49:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Creating volume 32f5575b-9251-4d5f-9c43-5ccd8f884990 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:49:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:49:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:49:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:49:35 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:49:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-32f5575b-9251-4d5f-9c43-5ccd8f884990 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b6ba0e3-973c-4ae8-ac28-6864647c40df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44b904e9-d5b9-4cd6-907b-d4beedd32795', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:35 devstack sudo[93328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-32f5575b-9251-4d5f-9c43-5ccd8f884990 1073741824 Apr 29 06:49:35 devstack sudo[93328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (826270e4-cad3-4a58-83ea-dbf15dc67742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:35 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Volume volume-44b904e9-d5b9-4cd6-907b-d4beedd32795 (44b904e9-d5b9-4cd6-907b-d4beedd32795): created successfully Apr 29 06:49:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (826270e4-cad3-4a58-83ea-dbf15dc67742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:35 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Flow 'volume_create_manager' (e752d1b3-3610-4a5a-8203-f5f1f4110529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:49:35 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-e39f3e6c-c1a8-4188-9fa0-df7d5042dc6d tempest-CreateVolumesFromImageTest-931600814 None] Created volume successfully. Apr 29 06:49:35 devstack sudo[93328]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-32f5575b-9251-4d5f-9c43-5ccd8f884990 1073741824" returned: 0 in 0.859s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-32f5575b-9251-4d5f-9c43-5ccd8f884990 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:36 devstack sudo[93334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-32f5575b-9251-4d5f-9c43-5ccd8f884990 Apr 29 06:49:36 devstack sudo[93334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:36 devstack cinder-volume[84195]: DEBUG oslo_service.periodic_task [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84195) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 06:49:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:49:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:49:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:36 devstack sudo[93337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:49:36 devstack sudo[93337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:36 devstack sudo[93334]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-32f5575b-9251-4d5f-9c43-5ccd8f884990" returned: 0 in 0.704s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:49:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1a5c6174-5df6-441b-8715-c0e347423887 tempest-VolumeDependencyTests-709056386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.586s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-1a5c6174-5df6-441b-8715-c0e347423887 tempest-VolumeDependencyTests-709056386 None] Creating offline snapshot 7f8e932f-9009-42ec-8ed5-102f56e0967a of volume 54128a7b-6c6f-40c6-8f74-2834dc76864f {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:49:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a30992f9-e12c-4483-92c4-1be0de74352f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32f5575b-9251-4d5f-9c43-5ccd8f884990', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d929d52c-998b-4cdf-bd18-a2721ed7f638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:36 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b3d532-8ca9-493c-b8cb-6817b021e875]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:49:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1a5c6174-5df6-441b-8715-c0e347423887 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:36 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Volume volume-32f5575b-9251-4d5f-9c43-5ccd8f884990 (32f5575b-9251-4d5f-9c43-5ccd8f884990): created successfully Apr 29 06:49:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d929d52c-998b-4cdf-bd18-a2721ed7f638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:36 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Flow 'volume_create_manager' (0ca3a7db-0e30-4c0c-843d-9e93ebf1727b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:49:36 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-807c4eaa-29ba-4c67-9012-f37fb14b6963 tempest-CreateVolumesFromImageTest-931600814 None] Created volume successfully. Apr 29 06:49:36 devstack sudo[93340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f Apr 29 06:49:36 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:37 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-be736886-9c88-41a5-8d7d-3ce6a4d7e31c tempest-CreateVolumesFromImageTest-931600814 None] Acquiring lock "cinder-32f5575b-9251-4d5f-9c43-5ccd8f884990-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:49:37 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-be736886-9c88-41a5-8d7d-3ce6a4d7e31c tempest-CreateVolumesFromImageTest-931600814 None] Lock "cinder-32f5575b-9251-4d5f-9c43-5ccd8f884990-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:49:37 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-be736886-9c88-41a5-8d7d-3ce6a4d7e31c tempest-CreateVolumesFromImageTest-931600814 None] Acquiring lock "cinder-quobyte-32f5575b-9251-4d5f-9c43-5ccd8f884990" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:49:37 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-be736886-9c88-41a5-8d7d-3ce6a4d7e31c tempest-CreateVolumesFromImageTest-931600814 None] Lock "cinder-quobyte-32f5575b-9251-4d5f-9c43-5ccd8f884990" acquired by "delete_volume" :: waited 0.024s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:49:37 devstack sudo[93337]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.742s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:37 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:49:37 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccba72a3-42bd-4506-9769-c32747d161b9]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:49:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-be736886-9c88-41a5-8d7d-3ce6a4d7e31c tempest-CreateVolumesFromImageTest-931600814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-32f5575b-9251-4d5f-9c43-5ccd8f884990 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:37 devstack sudo[93343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-32f5575b-9251-4d5f-9c43-5ccd8f884990 Apr 29 06:49:37 devstack sudo[93343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:37 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1a5c6174-5df6-441b-8715-c0e347423887 tempest-VolumeDependencyTests-709056386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f" returned: 0 in 0.911s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1a5c6174-5df6-441b-8715-c0e347423887 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.7f8e932f-9009-42ec-8ed5-102f56e0967a 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:37 devstack sudo[93348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.7f8e932f-9009-42ec-8ed5-102f56e0967a 1G Apr 29 06:49:37 devstack sudo[93348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:38 devstack sudo[93343]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-be736886-9c88-41a5-8d7d-3ce6a4d7e31c tempest-CreateVolumesFromImageTest-931600814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-32f5575b-9251-4d5f-9c43-5ccd8f884990" returned: 0 in 0.805s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-be736886-9c88-41a5-8d7d-3ce6a4d7e31c tempest-CreateVolumesFromImageTest-931600814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-32f5575b-9251-4d5f-9c43-5ccd8f884990 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:38 devstack sudo[93353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-32f5575b-9251-4d5f-9c43-5ccd8f884990 Apr 29 06:49:38 devstack sudo[93353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:38 devstack sudo[93348]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1a5c6174-5df6-441b-8715-c0e347423887 tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.7f8e932f-9009-42ec-8ed5-102f56e0967a 1G" returned: 0 in 0.872s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1a5c6174-5df6-441b-8715-c0e347423887 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54128a7b-6c6f-40c6-8f74-2834dc76864f -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.7f8e932f-9009-42ec-8ed5-102f56e0967a {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:38 devstack sudo[93359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54128a7b-6c6f-40c6-8f74-2834dc76864f -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.7f8e932f-9009-42ec-8ed5-102f56e0967a Apr 29 06:49:38 devstack sudo[93359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:38 devstack sudo[93353]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-be736886-9c88-41a5-8d7d-3ce6a4d7e31c tempest-CreateVolumesFromImageTest-931600814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-32f5575b-9251-4d5f-9c43-5ccd8f884990" returned: 0 in 0.681s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:38 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-be736886-9c88-41a5-8d7d-3ce6a4d7e31c tempest-CreateVolumesFromImageTest-931600814 None] Lock "cinder-quobyte-32f5575b-9251-4d5f-9c43-5ccd8f884990" released by "delete_volume" :: held 1.549s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:49:38 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-be736886-9c88-41a5-8d7d-3ce6a4d7e31c tempest-CreateVolumesFromImageTest-931600814 None] Created reservations ['1eb5e47d-e2a0-4bf5-b80a-5b9cc3297db6', 'd7a9e580-dd1b-44c2-b8d9-db943515504b', '1dd5ac78-c39c-4149-b519-2874091cfcfd', '2bd38269-8ed4-456d-978a-1a3e3292b556'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:49:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-be736886-9c88-41a5-8d7d-3ce6a4d7e31c tempest-CreateVolumesFromImageTest-931600814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-be736886-9c88-41a5-8d7d-3ce6a4d7e31c tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:39 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-be736886-9c88-41a5-8d7d-3ce6a4d7e31c tempest-CreateVolumesFromImageTest-931600814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:49:39 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-be736886-9c88-41a5-8d7d-3ce6a4d7e31c tempest-CreateVolumesFromImageTest-931600814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:49:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-be736886-9c88-41a5-8d7d-3ce6a4d7e31c tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-be736886-9c88-41a5-8d7d-3ce6a4d7e31c tempest-CreateVolumesFromImageTest-931600814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:39 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:49:39 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:39 devstack sudo[93359]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1a5c6174-5df6-441b-8715-c0e347423887 tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54128a7b-6c6f-40c6-8f74-2834dc76864f -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.7f8e932f-9009-42ec-8ed5-102f56e0967a" returned: 0 in 0.734s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:39 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-1a5c6174-5df6-441b-8715-c0e347423887 tempest-VolumeDependencyTests-709056386 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.7f8e932f-9009-42ec-8ed5-102f56e0967a is being set with open permissions: ugo+rw Apr 29 06:49:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1a5c6174-5df6-441b-8715-c0e347423887 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.7f8e932f-9009-42ec-8ed5-102f56e0967a {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:39 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.7f8e932f-9009-42ec-8ed5-102f56e0967a Apr 29 06:49:39 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:39 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f801147d-5b52-44dc-a8f8-f7bb399b796e tempest-CreateVolumesFromImageTest-931600814 None] Acquiring lock "cinder-44b904e9-d5b9-4cd6-907b-d4beedd32795-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:49:39 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f801147d-5b52-44dc-a8f8-f7bb399b796e tempest-CreateVolumesFromImageTest-931600814 None] Lock "cinder-44b904e9-d5b9-4cd6-907b-d4beedd32795-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:49:39 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f801147d-5b52-44dc-a8f8-f7bb399b796e tempest-CreateVolumesFromImageTest-931600814 None] Acquiring lock "cinder-quobyte-44b904e9-d5b9-4cd6-907b-d4beedd32795" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:49:39 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f801147d-5b52-44dc-a8f8-f7bb399b796e tempest-CreateVolumesFromImageTest-931600814 None] Lock "cinder-quobyte-44b904e9-d5b9-4cd6-907b-d4beedd32795" acquired by "delete_volume" :: waited 0.019s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:49:39 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde1faac-8b0a-4154-8eb2-da8b10bf38a8]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:49:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f801147d-5b52-44dc-a8f8-f7bb399b796e tempest-CreateVolumesFromImageTest-931600814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-44b904e9-d5b9-4cd6-907b-d4beedd32795 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:39 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-be736886-9c88-41a5-8d7d-3ce6a4d7e31c tempest-CreateVolumesFromImageTest-931600814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.686s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:39 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-be736886-9c88-41a5-8d7d-3ce6a4d7e31c tempest-CreateVolumesFromImageTest-931600814 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:49:39 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-be736886-9c88-41a5-8d7d-3ce6a4d7e31c tempest-CreateVolumesFromImageTest-931600814 None] Deleted volume successfully. Apr 29 06:49:39 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-be736886-9c88-41a5-8d7d-3ce6a4d7e31c tempest-CreateVolumesFromImageTest-931600814 None] Lock "cinder-32f5575b-9251-4d5f-9c43-5ccd8f884990-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:49:39 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-44b904e9-d5b9-4cd6-907b-d4beedd32795 Apr 29 06:49:39 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:40 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1a5c6174-5df6-441b-8715-c0e347423887 tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.7f8e932f-9009-42ec-8ed5-102f56e0967a" returned: 0 in 0.714s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1a5c6174-5df6-441b-8715-c0e347423887 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:40 devstack sudo[93373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.info Apr 29 06:49:40 devstack sudo[93373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:40 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f801147d-5b52-44dc-a8f8-f7bb399b796e tempest-CreateVolumesFromImageTest-931600814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-44b904e9-d5b9-4cd6-907b-d4beedd32795" returned: 0 in 0.776s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f801147d-5b52-44dc-a8f8-f7bb399b796e tempest-CreateVolumesFromImageTest-931600814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-44b904e9-d5b9-4cd6-907b-d4beedd32795 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:40 devstack sudo[93378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-44b904e9-d5b9-4cd6-907b-d4beedd32795 Apr 29 06:49:40 devstack sudo[93378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:40 devstack sudo[93373]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1a5c6174-5df6-441b-8715-c0e347423887 tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.info" returned: 0 in 0.642s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:40 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-1a5c6174-5df6-441b-8715-c0e347423887 tempest-VolumeDependencyTests-709056386 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.info is being set with open permissions: ugo+rw Apr 29 06:49:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1a5c6174-5df6-441b-8715-c0e347423887 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:40 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.info Apr 29 06:49:40 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:41 devstack sudo[93378]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f801147d-5b52-44dc-a8f8-f7bb399b796e tempest-CreateVolumesFromImageTest-931600814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-44b904e9-d5b9-4cd6-907b-d4beedd32795" returned: 0 in 0.715s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:41 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f801147d-5b52-44dc-a8f8-f7bb399b796e tempest-CreateVolumesFromImageTest-931600814 None] Lock "cinder-quobyte-44b904e9-d5b9-4cd6-907b-d4beedd32795" released by "delete_volume" :: held 1.545s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:49:41 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-f801147d-5b52-44dc-a8f8-f7bb399b796e tempest-CreateVolumesFromImageTest-931600814 None] Created reservations ['008e0681-22b0-4498-baf0-56267312030a', '880668f4-c769-4fd6-8822-e784fa316216', 'da62fa84-dba3-4f0d-9232-8ccd71ec9673', '6fc227cd-cb59-44cd-bb8b-4db4cdc490d4'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:49:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f801147d-5b52-44dc-a8f8-f7bb399b796e tempest-CreateVolumesFromImageTest-931600814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f801147d-5b52-44dc-a8f8-f7bb399b796e tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:41 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f801147d-5b52-44dc-a8f8-f7bb399b796e tempest-CreateVolumesFromImageTest-931600814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:49:41 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f801147d-5b52-44dc-a8f8-f7bb399b796e tempest-CreateVolumesFromImageTest-931600814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:49:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f801147d-5b52-44dc-a8f8-f7bb399b796e tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f801147d-5b52-44dc-a8f8-f7bb399b796e tempest-CreateVolumesFromImageTest-931600814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:41 devstack sudo[93385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:49:41 devstack sudo[93385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:41 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1a5c6174-5df6-441b-8715-c0e347423887 tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.info" returned: 0 in 0.661s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1a5c6174-5df6-441b-8715-c0e347423887 tempest-VolumeDependencyTests-709056386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.657s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2ba7d31f-3440-422a-b651-c687c6527ed1 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.038s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:41 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-2ba7d31f-3440-422a-b651-c687c6527ed1 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Creating offline snapshot 17ecb8e3-6f97-4e67-9dcf-c05ac6f937e8 of volume 5c133b96-63bd-42c2-8d2f-880a7121d974 {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:49:41 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ef4e78-5c69-4565-9e62-093fde9cb7cc]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:49:41 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2ba7d31f-3440-422a-b651-c687c6527ed1 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:41 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-1a5c6174-5df6-441b-8715-c0e347423887 tempest-VolumeDependencyTests-709056386 None] Create snapshot completed successfully Apr 29 06:49:41 devstack sudo[93387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974 Apr 29 06:49:41 devstack sudo[93387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:41 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-30a76d8e-fb15-4439-9d27-b27e6917a6ed tempest-CreateVolumesFromImageTest-931600814 None] Acquiring lock "cinder-cbd7d5c2-1653-41e7-9ae0-0b0ef653a9cd-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:49:41 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-30a76d8e-fb15-4439-9d27-b27e6917a6ed tempest-CreateVolumesFromImageTest-931600814 None] Lock "cinder-cbd7d5c2-1653-41e7-9ae0-0b0ef653a9cd-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:49:42 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-30a76d8e-fb15-4439-9d27-b27e6917a6ed tempest-CreateVolumesFromImageTest-931600814 None] Acquiring lock "cinder-quobyte-cbd7d5c2-1653-41e7-9ae0-0b0ef653a9cd" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:49:42 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-30a76d8e-fb15-4439-9d27-b27e6917a6ed tempest-CreateVolumesFromImageTest-931600814 None] Lock "cinder-quobyte-cbd7d5c2-1653-41e7-9ae0-0b0ef653a9cd" acquired by "delete_volume" :: waited 0.037s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:49:42 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[035cb568-dd50-4c29-8323-d3280954e370]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:49:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-30a76d8e-fb15-4439-9d27-b27e6917a6ed tempest-CreateVolumesFromImageTest-931600814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-cbd7d5c2-1653-41e7-9ae0-0b0ef653a9cd {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:42 devstack sudo[93385]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f801147d-5b52-44dc-a8f8-f7bb399b796e tempest-CreateVolumesFromImageTest-931600814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.936s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:42 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-f801147d-5b52-44dc-a8f8-f7bb399b796e tempest-CreateVolumesFromImageTest-931600814 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:49:42 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-f801147d-5b52-44dc-a8f8-f7bb399b796e tempest-CreateVolumesFromImageTest-931600814 None] Deleted volume successfully. Apr 29 06:49:42 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:49:42 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-f801147d-5b52-44dc-a8f8-f7bb399b796e tempest-CreateVolumesFromImageTest-931600814 None] Lock "cinder-44b904e9-d5b9-4cd6-907b-d4beedd32795-delete_volume" released by "delete_volume" :: held 2.743s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:49:42 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Flow 'volume_create_manager' (fcf3556a-f9e5-4304-96ec-9bc6b11712fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:49:42 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be8fdcd-2c18-46ec-9695-46572f171a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:42 devstack sudo[93390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-cbd7d5c2-1653-41e7-9ae0-0b0ef653a9cd Apr 29 06:49:42 devstack sudo[93390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:42 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be8fdcd-2c18-46ec-9695-46572f171a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1484076117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02c11bcc-b01b-4452-8ccf-2715ce2ffe80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace88f2823a14804b1907c40d5824803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7f8e932f-9009-42ec-8ed5-102f56e0967a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:42Z,use_quota=True,user_id='571613088c0d4fe6b2c336497496a0fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:42 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (293db131-9eae-4bcd-a304-305d68e6400d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:42 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (293db131-9eae-4bcd-a304-305d68e6400d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:42 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87ebcfd0-a43d-4d9c-a91e-17b393d8532d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:42 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87ebcfd0-a43d-4d9c-a91e-17b393d8532d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '02c11bcc-b01b-4452-8ccf-2715ce2ffe80', 'volume_name': 'volume-02c11bcc-b01b-4452-8ccf-2715ce2ffe80', 'volume_size': 1, 'snapshot_id': '7f8e932f-9009-42ec-8ed5-102f56e0967a'}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:42 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f2ac7b-3ad3-4dc0-8205-c90b6f40f257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:42 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f2ac7b-3ad3-4dc0-8205-c90b6f40f257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:42 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51439cd4-fd56-4592-a85d-faa9274d5f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:42 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Volume 02c11bcc-b01b-4452-8ccf-2715ce2ffe80: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-02c11bcc-b01b-4452-8ccf-2715ce2ffe80', 'volume_size': 1, 'snapshot_id': '7f8e932f-9009-42ec-8ed5-102f56e0967a'} Apr 29 06:49:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:42 devstack sudo[93387]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2ba7d31f-3440-422a-b651-c687c6527ed1 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974" returned: 0 in 0.979s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2ba7d31f-3440-422a-b651-c687c6527ed1 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974.17ecb8e3-6f97-4e67-9dcf-c05ac6f937e8 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:42 devstack sudo[93395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974.17ecb8e3-6f97-4e67-9dcf-c05ac6f937e8 1G Apr 29 06:49:42 devstack sudo[93395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:43 devstack sudo[93390]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-30a76d8e-fb15-4439-9d27-b27e6917a6ed tempest-CreateVolumesFromImageTest-931600814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-cbd7d5c2-1653-41e7-9ae0-0b0ef653a9cd" returned: 0 in 1.028s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-30a76d8e-fb15-4439-9d27-b27e6917a6ed tempest-CreateVolumesFromImageTest-931600814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-cbd7d5c2-1653-41e7-9ae0-0b0ef653a9cd {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:43 devstack sudo[93401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-cbd7d5c2-1653-41e7-9ae0-0b0ef653a9cd Apr 29 06:49:43 devstack sudo[93401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:43 devstack sudo[93395]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2ba7d31f-3440-422a-b651-c687c6527ed1 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974.17ecb8e3-6f97-4e67-9dcf-c05ac6f937e8 1G" returned: 0 in 1.097s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2ba7d31f-3440-422a-b651-c687c6527ed1 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c133b96-63bd-42c2-8d2f-880a7121d974 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974.17ecb8e3-6f97-4e67-9dcf-c05ac6f937e8 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:43 devstack sudo[93405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c133b96-63bd-42c2-8d2f-880a7121d974 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974.17ecb8e3-6f97-4e67-9dcf-c05ac6f937e8 Apr 29 06:49:43 devstack sudo[93405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:43 devstack sudo[93401]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-30a76d8e-fb15-4439-9d27-b27e6917a6ed tempest-CreateVolumesFromImageTest-931600814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-cbd7d5c2-1653-41e7-9ae0-0b0ef653a9cd" returned: 0 in 0.679s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:43 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-30a76d8e-fb15-4439-9d27-b27e6917a6ed tempest-CreateVolumesFromImageTest-931600814 None] Lock "cinder-quobyte-cbd7d5c2-1653-41e7-9ae0-0b0ef653a9cd" released by "delete_volume" :: held 1.782s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:49:43 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-30a76d8e-fb15-4439-9d27-b27e6917a6ed tempest-CreateVolumesFromImageTest-931600814 None] Created reservations ['24824c75-46ca-4c2b-b0d5-c8c326f3cd8d', 'c7cd5113-d17f-4cd1-a434-b0945c942529', '76a313b9-e42a-4382-88f4-27f4762b0c7e', '389159d1-edcb-4021-8e7c-d896e6cb4f89'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:49:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-30a76d8e-fb15-4439-9d27-b27e6917a6ed tempest-CreateVolumesFromImageTest-931600814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-30a76d8e-fb15-4439-9d27-b27e6917a6ed tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:43 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-30a76d8e-fb15-4439-9d27-b27e6917a6ed tempest-CreateVolumesFromImageTest-931600814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:49:44 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-30a76d8e-fb15-4439-9d27-b27e6917a6ed tempest-CreateVolumesFromImageTest-931600814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:49:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-30a76d8e-fb15-4439-9d27-b27e6917a6ed tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-30a76d8e-fb15-4439-9d27-b27e6917a6ed tempest-CreateVolumesFromImageTest-931600814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:44 devstack sudo[93408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:49:44 devstack sudo[93408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:44 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9cde2942-95c3-42d9-98f1-de9acfa46a0c tempest-CreateVolumesFromImageTest-931600814 None] Acquiring lock "cinder-82fba6af-ce86-49c1-8dc1-dc1e40faeb66-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:49:44 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9cde2942-95c3-42d9-98f1-de9acfa46a0c tempest-CreateVolumesFromImageTest-931600814 None] Lock "cinder-82fba6af-ce86-49c1-8dc1-dc1e40faeb66-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:49:44 devstack sudo[93405]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2ba7d31f-3440-422a-b651-c687c6527ed1 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c133b96-63bd-42c2-8d2f-880a7121d974 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974.17ecb8e3-6f97-4e67-9dcf-c05ac6f937e8" returned: 0 in 0.811s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:44 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-2ba7d31f-3440-422a-b651-c687c6527ed1 tempest-CreateVolumesFromSnapshotTest-1486202130 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974.17ecb8e3-6f97-4e67-9dcf-c05ac6f937e8 is being set with open permissions: ugo+rw Apr 29 06:49:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2ba7d31f-3440-422a-b651-c687c6527ed1 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974.17ecb8e3-6f97-4e67-9dcf-c05ac6f937e8 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:44 devstack sudo[93413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974.17ecb8e3-6f97-4e67-9dcf-c05ac6f937e8 Apr 29 06:49:44 devstack sudo[93413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:44 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9cde2942-95c3-42d9-98f1-de9acfa46a0c tempest-CreateVolumesFromImageTest-931600814 None] Acquiring lock "cinder-quobyte-82fba6af-ce86-49c1-8dc1-dc1e40faeb66" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:49:44 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9cde2942-95c3-42d9-98f1-de9acfa46a0c tempest-CreateVolumesFromImageTest-931600814 None] Lock "cinder-quobyte-82fba6af-ce86-49c1-8dc1-dc1e40faeb66" acquired by "delete_volume" :: waited 0.022s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:49:44 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92739a5-af71-4c4b-9155-09902e01c1dd]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:49:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9cde2942-95c3-42d9-98f1-de9acfa46a0c tempest-CreateVolumesFromImageTest-931600814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-82fba6af-ce86-49c1-8dc1-dc1e40faeb66 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:44 devstack sudo[93415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-82fba6af-ce86-49c1-8dc1-dc1e40faeb66 Apr 29 06:49:44 devstack sudo[93415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:44 devstack sudo[93408]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-30a76d8e-fb15-4439-9d27-b27e6917a6ed tempest-CreateVolumesFromImageTest-931600814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.830s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:44 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-30a76d8e-fb15-4439-9d27-b27e6917a6ed tempest-CreateVolumesFromImageTest-931600814 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:49:44 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-30a76d8e-fb15-4439-9d27-b27e6917a6ed tempest-CreateVolumesFromImageTest-931600814 None] Deleted volume successfully. Apr 29 06:49:44 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-30a76d8e-fb15-4439-9d27-b27e6917a6ed tempest-CreateVolumesFromImageTest-931600814 None] Lock "cinder-cbd7d5c2-1653-41e7-9ae0-0b0ef653a9cd-delete_volume" released by "delete_volume" :: held 2.964s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:49:45 devstack sudo[93413]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2ba7d31f-3440-422a-b651-c687c6527ed1 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974.17ecb8e3-6f97-4e67-9dcf-c05ac6f937e8" returned: 0 in 0.765s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2ba7d31f-3440-422a-b651-c687c6527ed1 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:45 devstack sudo[93419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974.info Apr 29 06:49:45 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:45 devstack sudo[93415]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9cde2942-95c3-42d9-98f1-de9acfa46a0c tempest-CreateVolumesFromImageTest-931600814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-82fba6af-ce86-49c1-8dc1-dc1e40faeb66" returned: 0 in 0.908s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9cde2942-95c3-42d9-98f1-de9acfa46a0c tempest-CreateVolumesFromImageTest-931600814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-82fba6af-ce86-49c1-8dc1-dc1e40faeb66 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:45 devstack sudo[93424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-82fba6af-ce86-49c1-8dc1-dc1e40faeb66 Apr 29 06:49:45 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:45 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2ba7d31f-3440-422a-b651-c687c6527ed1 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974.info" returned: 0 in 0.738s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:45 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-2ba7d31f-3440-422a-b651-c687c6527ed1 tempest-CreateVolumesFromSnapshotTest-1486202130 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974.info is being set with open permissions: ugo+rw Apr 29 06:49:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2ba7d31f-3440-422a-b651-c687c6527ed1 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:45 devstack sudo[93427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974.info Apr 29 06:49:45 devstack sudo[93427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:46 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9cde2942-95c3-42d9-98f1-de9acfa46a0c tempest-CreateVolumesFromImageTest-931600814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-82fba6af-ce86-49c1-8dc1-dc1e40faeb66" returned: 0 in 0.723s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9cde2942-95c3-42d9-98f1-de9acfa46a0c tempest-CreateVolumesFromImageTest-931600814 None] Lock "cinder-quobyte-82fba6af-ce86-49c1-8dc1-dc1e40faeb66" released by "delete_volume" :: held 1.699s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-9cde2942-95c3-42d9-98f1-de9acfa46a0c tempest-CreateVolumesFromImageTest-931600814 None] Created reservations ['b132ca2d-ae89-4653-a820-4a8c42905ba2', '50951e4c-9d37-4fcf-a439-7c3ef2bc097b', 'e65c8431-e1e1-421a-b9b9-6965b68c8c8f', 'ac381c95-93b2-452c-a4d1-9de9e6e19531'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9cde2942-95c3-42d9-98f1-de9acfa46a0c tempest-CreateVolumesFromImageTest-931600814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9cde2942-95c3-42d9-98f1-de9acfa46a0c tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9cde2942-95c3-42d9-98f1-de9acfa46a0c tempest-CreateVolumesFromImageTest-931600814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9cde2942-95c3-42d9-98f1-de9acfa46a0c tempest-CreateVolumesFromImageTest-931600814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9cde2942-95c3-42d9-98f1-de9acfa46a0c tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9cde2942-95c3-42d9-98f1-de9acfa46a0c tempest-CreateVolumesFromImageTest-931600814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:46 devstack sudo[93430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:49:46 devstack sudo[93430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:46 devstack sudo[93427]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2ba7d31f-3440-422a-b651-c687c6527ed1 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974.info" returned: 0 in 0.693s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2ba7d31f-3440-422a-b651-c687c6527ed1 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.194s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.214s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Acquiring lock "cinder-quobyte-7f8e932f-9009-42ec-8ed5-102f56e0967a-02c11bcc-b01b-4452-8ccf-2715ce2ffe80" by "_create_volume_from_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ec68b572-2ec6-4117-a20b-38eb8a22e498 tempest-CreateVolumesFromImageTest-931600814 None] Acquiring lock "cinder-879bbbc8-d489-4f93-a3a9-60d3a9a025d3-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ec68b572-2ec6-4117-a20b-38eb8a22e498 tempest-CreateVolumesFromImageTest-931600814 None] Lock "cinder-879bbbc8-d489-4f93-a3a9-60d3a9a025d3-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Lock "cinder-quobyte-7f8e932f-9009-42ec-8ed5-102f56e0967a-02c11bcc-b01b-4452-8ccf-2715ce2ffe80" acquired by "_create_volume_from_snapshot" :: waited 0.061s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Creating volume 02c11bcc-b01b-4452-8ccf-2715ce2ffe80 from snapshot 7f8e932f-9009-42ec-8ed5-102f56e0967a {{(pid=84195) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Acquiring lock "cinder-quobyte-02c11bcc-b01b-4452-8ccf-2715ce2ffe80" by "_copy_volume_from_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:49:46 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-2ba7d31f-3440-422a-b651-c687c6527ed1 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Create snapshot completed successfully Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Lock "cinder-quobyte-02c11bcc-b01b-4452-8ccf-2715ce2ffe80" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] snapshot: 7f8e932f-9009-42ec-8ed5-102f56e0967a, volume: 02c11bcc-b01b-4452-8ccf-2715ce2ffe80, {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ec68b572-2ec6-4117-a20b-38eb8a22e498 tempest-CreateVolumesFromImageTest-931600814 None] Acquiring lock "cinder-quobyte-879bbbc8-d489-4f93-a3a9-60d3a9a025d3" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[936b2b41-7103-438c-a719-cb098eac4b09]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.7f8e932f-9009-42ec-8ed5-102f56e0967a {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ec68b572-2ec6-4117-a20b-38eb8a22e498 tempest-CreateVolumesFromImageTest-931600814 None] Lock "cinder-quobyte-879bbbc8-d489-4f93-a3a9-60d3a9a025d3" acquired by "delete_volume" :: waited 0.036s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[732b92b6-10e3-4125-8cc8-eb23ccca9a12]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ec68b572-2ec6-4117-a20b-38eb8a22e498 tempest-CreateVolumesFromImageTest-931600814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-879bbbc8-d489-4f93-a3a9-60d3a9a025d3 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:46 devstack sudo[93430]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9cde2942-95c3-42d9-98f1-de9acfa46a0c tempest-CreateVolumesFromImageTest-931600814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.713s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-9cde2942-95c3-42d9-98f1-de9acfa46a0c tempest-CreateVolumesFromImageTest-931600814 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:49:46 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-9cde2942-95c3-42d9-98f1-de9acfa46a0c tempest-CreateVolumesFromImageTest-931600814 None] Deleted volume successfully. Apr 29 06:49:46 devstack sudo[93437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-879bbbc8-d489-4f93-a3a9-60d3a9a025d3 Apr 29 06:49:46 devstack sudo[93437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9cde2942-95c3-42d9-98f1-de9acfa46a0c tempest-CreateVolumesFromImageTest-931600814 None] Lock "cinder-82fba6af-ce86-49c1-8dc1-dc1e40faeb66-delete_volume" released by "delete_volume" :: held 2.681s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:49:46 devstack sudo[93434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.7f8e932f-9009-42ec-8ed5-102f56e0967a Apr 29 06:49:46 devstack sudo[93434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:47 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:49:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Flow 'volume_create_manager' (59149f89-27f2-4756-bf13-1dc9e7b67934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:49:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d830d281-cc89-4385-99bd-25ee6cdb4a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d830d281-cc89-4385-99bd-25ee6cdb4a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1468420174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f2b6c7-2455-4fac-983e-dd7c78e79ef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb6727e6db924ee09fc3e7750334117d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:48Z,use_quota=True,user_id='9885cfc171114c7a93afbc2c6f918ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188aabe0-d8d6-4b29-82c4-4c86638e9a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188aabe0-d8d6-4b29-82c4-4c86638e9a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f21cd5bd-7424-4dc3-b1aa-be26269abf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f21cd5bd-7424-4dc3-b1aa-be26269abf64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68f2b6c7-2455-4fac-983e-dd7c78e79ef3', 'volume_name': 'volume-68f2b6c7-2455-4fac-983e-dd7c78e79ef3', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bcf273c-ee48-4cdd-ab35-028d39090c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bcf273c-ee48-4cdd-ab35-028d39090c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b242dfa1-2fdb-49c6-9a6c-da975ee08b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:47 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Volume 68f2b6c7-2455-4fac-983e-dd7c78e79ef3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68f2b6c7-2455-4fac-983e-dd7c78e79ef3', 'volume_size': 1} Apr 29 06:49:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:47 devstack sudo[93437]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ec68b572-2ec6-4117-a20b-38eb8a22e498 tempest-CreateVolumesFromImageTest-931600814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-879bbbc8-d489-4f93-a3a9-60d3a9a025d3" returned: 0 in 1.047s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ec68b572-2ec6-4117-a20b-38eb8a22e498 tempest-CreateVolumesFromImageTest-931600814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-879bbbc8-d489-4f93-a3a9-60d3a9a025d3 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:47 devstack sudo[93446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-879bbbc8-d489-4f93-a3a9-60d3a9a025d3 Apr 29 06:49:47 devstack sudo[93446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:47 devstack sudo[93434]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.7f8e932f-9009-42ec-8ed5-102f56e0967a" returned: 0 in 1.232s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54128a7b-6c6f-40c6-8f74-2834dc76864f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Creating direct copy from snapshot {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee002c1-51f8-4d15-a11a-53a17b724324]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:49:48 devstack sudo[93448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f Apr 29 06:49:48 devstack sudo[93448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Flow 'volume_create_manager' (4339f282-2308-4143-bc77-40ddef0cc1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc510b33-e73f-429b-9ad7-0302c2351eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc510b33-e73f-429b-9ad7-0302c2351eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-394802795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb3f730-be84-4206-8e6d-fa00b542278c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb6727e6db924ee09fc3e7750334117d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:48Z,use_quota=True,user_id='9885cfc171114c7a93afbc2c6f918ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa7ba288-6be0-4c73-a554-f64872ac12f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa7ba288-6be0-4c73-a554-f64872ac12f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (606bb581-b1fb-4717-80fe-244c6f815eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (606bb581-b1fb-4717-80fe-244c6f815eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fb3f730-be84-4206-8e6d-fa00b542278c', 'volume_name': 'volume-6fb3f730-be84-4206-8e6d-fa00b542278c', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d68c01ce-62db-4311-a4c8-3da9d97f1cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d68c01ce-62db-4311-a4c8-3da9d97f1cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211ee3f5-6763-40b3-bdf0-482c7f9363f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:48 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Volume 6fb3f730-be84-4206-8e6d-fa00b542278c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fb3f730-be84-4206-8e6d-fa00b542278c', 'volume_size': 1} Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Flow 'volume_create_manager' (060c4b15-35dd-4e9e-b3e3-0ff75ab7399a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef0ad1e-3e5f-4059-82b7-e05257ab1c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef0ad1e-3e5f-4059-82b7-e05257ab1c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2041205537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62048891-44b8-4d54-a535-2a7b0261a03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb6727e6db924ee09fc3e7750334117d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:49Z,use_quota=True,user_id='9885cfc171114c7a93afbc2c6f918ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (956d7bda-dffa-458c-b858-60d5c28b3dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (956d7bda-dffa-458c-b858-60d5c28b3dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f350644-b734-4c09-b60e-5b609855d425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f350644-b734-4c09-b60e-5b609855d425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62048891-44b8-4d54-a535-2a7b0261a03b', 'volume_name': 'volume-62048891-44b8-4d54-a535-2a7b0261a03b', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5671119-4904-4d77-b020-d4a64a222476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5671119-4904-4d77-b020-d4a64a222476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:48 devstack sudo[93446]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b309fe-cce3-4cb1-b8fe-8f973ecd53ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:48 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Volume 62048891-44b8-4d54-a535-2a7b0261a03b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62048891-44b8-4d54-a535-2a7b0261a03b', 'volume_size': 1} Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ec68b572-2ec6-4117-a20b-38eb8a22e498 tempest-CreateVolumesFromImageTest-931600814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-879bbbc8-d489-4f93-a3a9-60d3a9a025d3" returned: 0 in 1.073s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:48 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ec68b572-2ec6-4117-a20b-38eb8a22e498 tempest-CreateVolumesFromImageTest-931600814 None] Lock "cinder-quobyte-879bbbc8-d489-4f93-a3a9-60d3a9a025d3" released by "delete_volume" :: held 2.170s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:49:49 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-ec68b572-2ec6-4117-a20b-38eb8a22e498 tempest-CreateVolumesFromImageTest-931600814 None] Created reservations ['38a41d3a-db59-479b-b7fb-f7da582e14f3', '245e9e74-6286-44aa-84c0-83afa89fccbd', '46ea4151-3dce-49ce-9c44-08d8a56b50b7', '099fa532-7260-40a4-902c-b818542585ff'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:49:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-ec68b572-2ec6-4117-a20b-38eb8a22e498 tempest-CreateVolumesFromImageTest-931600814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-ec68b572-2ec6-4117-a20b-38eb8a22e498 tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-ec68b572-2ec6-4117-a20b-38eb8a22e498 tempest-CreateVolumesFromImageTest-931600814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:49:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-ec68b572-2ec6-4117-a20b-38eb8a22e498 tempest-CreateVolumesFromImageTest-931600814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:49:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-ec68b572-2ec6-4117-a20b-38eb8a22e498 tempest-CreateVolumesFromImageTest-931600814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ec68b572-2ec6-4117-a20b-38eb8a22e498 tempest-CreateVolumesFromImageTest-931600814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:49 devstack sudo[93451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:49:49 devstack sudo[93451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:49 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:49:49 devstack sudo[93448]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Flow 'volume_create_manager' (7da749ce-c513-4129-922a-a89ce50dccd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:49:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0580e02f-dcdd-420a-841d-a722e97f820d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f" returned: 0 in 1.562s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:49 devstack cinder-volume[84195]: DEBUG cinder.utils [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Path /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-02c11bcc-b01b-4452-8ccf-2715ce2ffe80 not found in is_blk_device check {{(pid=84195) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 06:49:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-02c11bcc-b01b-4452-8ccf-2715ce2ffe80 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0580e02f-dcdd-420a-841d-a722e97f820d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-705740107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408dd9b6-dafc-4794-997e-fcc9dd1f2548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb6727e6db924ee09fc3e7750334117d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:49Z,use_quota=True,user_id='9885cfc171114c7a93afbc2c6f918ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f995cf2a-1636-4da2-a3a5-c64a2c6b6eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f995cf2a-1636-4da2-a3a5-c64a2c6b6eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e36a7ac-fa73-45ee-b0e3-f0e3fa215cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:49 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-02c11bcc-b01b-4452-8ccf-2715ce2ffe80 Apr 29 06:49:49 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e36a7ac-fa73-45ee-b0e3-f0e3fa215cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '408dd9b6-dafc-4794-997e-fcc9dd1f2548', 'volume_name': 'volume-408dd9b6-dafc-4794-997e-fcc9dd1f2548', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef02aa4-fefa-4d9e-ad5b-cf6647a458b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef02aa4-fefa-4d9e-ad5b-cf6647a458b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dafbbf0-24f1-423e-a728-a6c765a1a18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:49 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Volume 408dd9b6-dafc-4794-997e-fcc9dd1f2548: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-408dd9b6-dafc-4794-997e-fcc9dd1f2548', 'volume_size': 1} Apr 29 06:49:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:50 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:49:50 devstack sudo[93451]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Flow 'volume_create_manager' (84a3d584-0d6e-4d9e-8ff4-49116ff32c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:49:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e0d376-85d7-460c-8cfa-8c1dfa02af98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-ec68b572-2ec6-4117-a20b-38eb8a22e498 tempest-CreateVolumesFromImageTest-931600814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.894s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:50 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-ec68b572-2ec6-4117-a20b-38eb8a22e498 tempest-CreateVolumesFromImageTest-931600814 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:49:50 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-ec68b572-2ec6-4117-a20b-38eb8a22e498 tempest-CreateVolumesFromImageTest-931600814 None] Deleted volume successfully. Apr 29 06:49:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e0d376-85d7-460c-8cfa-8c1dfa02af98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-883771764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d526c3e7-ae1f-46ad-88e0-a4a86c577f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb6727e6db924ee09fc3e7750334117d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:50Z,use_quota=True,user_id='9885cfc171114c7a93afbc2c6f918ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3957c9c-c21c-4236-98f6-de0249aeb8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3957c9c-c21c-4236-98f6-de0249aeb8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71820f4f-dcc9-463c-8fec-6f66158ac46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71820f4f-dcc9-463c-8fec-6f66158ac46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd526c3e7-ae1f-46ad-88e0-a4a86c577f1d', 'volume_name': 'volume-d526c3e7-ae1f-46ad-88e0-a4a86c577f1d', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (071d59e4-d6df-4b67-b1fc-56775e023d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (071d59e4-d6df-4b67-b1fc-56775e023d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d46f2c-4072-467c-a0d7-4330ade3366d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:50 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Volume d526c3e7-ae1f-46ad-88e0-a4a86c577f1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d526c3e7-ae1f-46ad-88e0-a4a86c577f1d', 'volume_size': 1} Apr 29 06:49:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:50 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-ec68b572-2ec6-4117-a20b-38eb8a22e498 tempest-CreateVolumesFromImageTest-931600814 None] Lock "cinder-879bbbc8-d489-4f93-a3a9-60d3a9a025d3-delete_volume" released by "delete_volume" :: held 3.534s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:49:50 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:49:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Flow 'volume_create_manager' (27d4830d-853c-41e2-8b6e-9a0621b6e48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:49:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dccf921e-4aeb-43d5-a7d7-a60738696e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dccf921e-4aeb-43d5-a7d7-a60738696e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-940273821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6359c89-ba9b-46a2-b605-d9300aaadef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d249a88184f4b94a41c862a9a3d838f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:50Z,use_quota=True,user_id='3a10b2896b124a3dbb43c7705bb0fac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d4ac66a-173c-4d0e-aa93-e3b177778c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d4ac66a-173c-4d0e-aa93-e3b177778c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa2d72f-1bdf-44fb-a76b-9eebd70c09cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa2d72f-1bdf-44fb-a76b-9eebd70c09cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6359c89-ba9b-46a2-b605-d9300aaadef7', 'volume_name': 'volume-e6359c89-ba9b-46a2-b605-d9300aaadef7', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebdc2bbd-b5f1-4421-b96f-c65ebf703958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebdc2bbd-b5f1-4421-b96f-c65ebf703958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b38a6e-d5fb-4c1c-9f0d-e1715dceb779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:50 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Volume e6359c89-ba9b-46a2-b605-d9300aaadef7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6359c89-ba9b-46a2-b605-d9300aaadef7', 'volume_size': 1} Apr 29 06:49:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:55 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-02c11bcc-b01b-4452-8ccf-2715ce2ffe80" returned: 0 in 5.771s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:55 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2319c2-cd9b-4fc7-be12-af1780f4eff4]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:49:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:55 devstack sudo[93470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f Apr 29 06:49:55 devstack sudo[93470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:55 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:UPDATE=103,cinder:INSERT=22,cinder:SELECT=69,cinder:DELETE=9 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:49:55 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:49:55 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Flow 'volume_create_manager' (6c2093e9-2a8b-402b-868a-0dd634721215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:49:55 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c32fcd2-9833-4d65-a309-34fe34440546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:55 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c32fcd2-9833-4d65-a309-34fe34440546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1147217046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8737439d-cec9-4fa7-a157-8b04b5838532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd1f691a145456db8e139d2c27a22b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:56Z,use_quota=True,user_id='db7ed9321fca423e89016a187ead5008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:55 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e938799f-4cb7-467f-bf78-8b3e776ea0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:55 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e938799f-4cb7-467f-bf78-8b3e776ea0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:55 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf301cc4-fa14-4cf6-b047-fa085a88d2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:55 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf301cc4-fa14-4cf6-b047-fa085a88d2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8737439d-cec9-4fa7-a157-8b04b5838532', 'volume_name': 'volume-8737439d-cec9-4fa7-a157-8b04b5838532', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:55 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d45eff9a-52eb-497b-b79c-d6f22f46d9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:55 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d45eff9a-52eb-497b-b79c-d6f22f46d9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:55 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac71f43-ed20-4ea5-81e1-cd7f2bbc2287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:55 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Volume 8737439d-cec9-4fa7-a157-8b04b5838532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8737439d-cec9-4fa7-a157-8b04b5838532', 'volume_size': 1} Apr 29 06:49:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:56 devstack sudo[93470]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f" returned: 0 in 0.888s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:56 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Image conversion details: src /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f, size 1024.00 MB, duration 5.77 sec, destination /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-02c11bcc-b01b-4452-8ccf-2715ce2ffe80 {{(pid=84195) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 06:49:56 devstack cinder-volume[84195]: INFO cinder.image.image_utils [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Converted 1024.00 MB image at 177.41 MB/s Apr 29 06:49:56 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-02c11bcc-b01b-4452-8ccf-2715ce2ffe80 is being set with open permissions: ugo+rw Apr 29 06:49:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-02c11bcc-b01b-4452-8ccf-2715ce2ffe80 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:56 devstack sudo[93475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-02c11bcc-b01b-4452-8ccf-2715ce2ffe80 Apr 29 06:49:56 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:56 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-02c11bcc-b01b-4452-8ccf-2715ce2ffe80" returned: 0 in 0.582s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:56 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Lock "cinder-quobyte-02c11bcc-b01b-4452-8ccf-2715ce2ffe80" released by "_copy_volume_from_snapshot" :: held 10.169s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:49:56 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Lock "cinder-quobyte-7f8e932f-9009-42ec-8ed5-102f56e0967a-02c11bcc-b01b-4452-8ccf-2715ce2ffe80" released by "_create_volume_from_snapshot" :: held 10.216s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:49:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.279s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.184s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1468420174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f2b6c7-2455-4fac-983e-dd7c78e79ef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb6727e6db924ee09fc3e7750334117d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:48Z,use_quota=True,user_id='9885cfc171114c7a93afbc2c6f918ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:49:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Creating volume 68f2b6c7-2455-4fac-983e-dd7c78e79ef3 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:49:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:49:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:49:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:49:56 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:49:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-68f2b6c7-2455-4fac-983e-dd7c78e79ef3 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:56 devstack sudo[93480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-68f2b6c7-2455-4fac-983e-dd7c78e79ef3 1073741824 Apr 29 06:49:56 devstack sudo[93480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:56 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51439cd4-fd56-4592-a85d-faa9274d5f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02c11bcc-b01b-4452-8ccf-2715ce2ffe80', 'volume_size': 1, 'snapshot_id': '7f8e932f-9009-42ec-8ed5-102f56e0967a'}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:56 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88c77112-a37b-41de-b13a-eddd2c40eba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:56 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Volume volume-02c11bcc-b01b-4452-8ccf-2715ce2ffe80 (02c11bcc-b01b-4452-8ccf-2715ce2ffe80): created successfully Apr 29 06:49:56 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88c77112-a37b-41de-b13a-eddd2c40eba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:56 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Flow 'volume_create_manager' (fcf3556a-f9e5-4304-96ec-9bc6b11712fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:49:56 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-d856f852-0c53-4b48-b276-91b8862207fa tempest-VolumeDependencyTests-709056386 None] Created volume successfully. Apr 29 06:49:57 devstack sudo[93480]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-68f2b6c7-2455-4fac-983e-dd7c78e79ef3 1073741824" returned: 0 in 0.783s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-68f2b6c7-2455-4fac-983e-dd7c78e79ef3 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:57 devstack sudo[93485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-68f2b6c7-2455-4fac-983e-dd7c78e79ef3 Apr 29 06:49:57 devstack sudo[93485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:57 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-72c39369-15a2-43fa-a871-a78b0fe31f6e tempest-VolumeDependencyTests-709056386 None] Acquiring lock "cinder-7f8e932f-9009-42ec-8ed5-102f56e0967a-delete_snapshot" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:49:57 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-72c39369-15a2-43fa-a871-a78b0fe31f6e tempest-VolumeDependencyTests-709056386 None] Lock "cinder-7f8e932f-9009-42ec-8ed5-102f56e0967a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:49:57 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-72c39369-15a2-43fa-a871-a78b0fe31f6e tempest-VolumeDependencyTests-709056386 None] Acquiring lock "cinder-quobyte-54128a7b-6c6f-40c6-8f74-2834dc76864f" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:49:57 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-72c39369-15a2-43fa-a871-a78b0fe31f6e tempest-VolumeDependencyTests-709056386 None] Lock "cinder-quobyte-54128a7b-6c6f-40c6-8f74-2834dc76864f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:49:57 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-72c39369-15a2-43fa-a871-a78b0fe31f6e tempest-VolumeDependencyTests-709056386 None] Acquiring lock "cinder-quobyte-7f8e932f-9009-42ec-8ed5-102f56e0967a" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:49:57 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-72c39369-15a2-43fa-a871-a78b0fe31f6e tempest-VolumeDependencyTests-709056386 None] Lock "cinder-quobyte-7f8e932f-9009-42ec-8ed5-102f56e0967a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:49:57 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-72c39369-15a2-43fa-a871-a78b0fe31f6e tempest-VolumeDependencyTests-709056386 None] Deleting offline snapshot 7f8e932f-9009-42ec-8ed5-102f56e0967a of volume 54128a7b-6c6f-40c6-8f74-2834dc76864f {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:49:57 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-72c39369-15a2-43fa-a871-a78b0fe31f6e tempest-VolumeDependencyTests-709056386 None] snapshot_file for this snap is: volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.7f8e932f-9009-42ec-8ed5-102f56e0967a {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:49:57 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51f7553-16b0-49da-914e-c4bc03f483ef]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:49:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-72c39369-15a2-43fa-a871-a78b0fe31f6e tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.7f8e932f-9009-42ec-8ed5-102f56e0967a {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:58 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.7f8e932f-9009-42ec-8ed5-102f56e0967a Apr 29 06:49:58 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:58 devstack sudo[93485]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-68f2b6c7-2455-4fac-983e-dd7c78e79ef3" returned: 0 in 0.597s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:58 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:49:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.818s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:58 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-394802795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb3f730-be84-4206-8e6d-fa00b542278c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb6727e6db924ee09fc3e7750334117d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:48Z,use_quota=True,user_id='9885cfc171114c7a93afbc2c6f918ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:49:58 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Creating volume 6fb3f730-be84-4206-8e6d-fa00b542278c {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:49:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:58 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:49:58 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:49:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:58 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:49:58 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:49:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6fb3f730-be84-4206-8e6d-fa00b542278c 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:58 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b242dfa1-2fdb-49c6-9a6c-da975ee08b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68f2b6c7-2455-4fac-983e-dd7c78e79ef3', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:58 devstack sudo[93490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6fb3f730-be84-4206-8e6d-fa00b542278c 1073741824 Apr 29 06:49:58 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:58 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84435c3c-ad55-43b3-82e7-ad7be84fe5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:58 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Volume volume-68f2b6c7-2455-4fac-983e-dd7c78e79ef3 (68f2b6c7-2455-4fac-983e-dd7c78e79ef3): created successfully Apr 29 06:49:58 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84435c3c-ad55-43b3-82e7-ad7be84fe5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:58 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Flow 'volume_create_manager' (59149f89-27f2-4756-bf13-1dc9e7b67934) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:49:58 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-80cb01b8-e2a3-4975-a9a6-e8aa83791bab tempest-CreateVolumesFromSnapshotTest-1486202130 None] Created volume successfully. Apr 29 06:49:58 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-72c39369-15a2-43fa-a871-a78b0fe31f6e tempest-VolumeDependencyTests-709056386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.7f8e932f-9009-42ec-8ed5-102f56e0967a" returned: 0 in 0.726s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:58 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-72c39369-15a2-43fa-a871-a78b0fe31f6e tempest-VolumeDependencyTests-709056386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54128a7b-6c6f-40c6-8f74-2834dc76864f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:49:58 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef1dc2f-d297-42f1-b344-0309ff702b30]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:49:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-72c39369-15a2-43fa-a871-a78b0fe31f6e tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:58 devstack sudo[93495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f Apr 29 06:49:58 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:59 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6fb3f730-be84-4206-8e6d-fa00b542278c 1073741824" returned: 0 in 0.785s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6fb3f730-be84-4206-8e6d-fa00b542278c {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:59 devstack sudo[93501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6fb3f730-be84-4206-8e6d-fa00b542278c Apr 29 06:49:59 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:59 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-72c39369-15a2-43fa-a871-a78b0fe31f6e tempest-VolumeDependencyTests-709056386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f" returned: 0 in 0.725s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-72c39369-15a2-43fa-a871-a78b0fe31f6e tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.7f8e932f-9009-42ec-8ed5-102f56e0967a {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:59 devstack sudo[93506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.7f8e932f-9009-42ec-8ed5-102f56e0967a Apr 29 06:49:59 devstack sudo[93506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:59 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root Apr 29 06:49:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6fb3f730-be84-4206-8e6d-fa00b542278c" returned: 0 in 0.579s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:49:59 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:49:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.802s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:59 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2041205537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62048891-44b8-4d54-a535-2a7b0261a03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb6727e6db924ee09fc3e7750334117d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:49Z,use_quota=True,user_id='9885cfc171114c7a93afbc2c6f918ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:49:59 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Creating volume 62048891-44b8-4d54-a535-2a7b0261a03b {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:49:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:49:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:49:59 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:49:59 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:49:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:49:59 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:49:59 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:49:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-62048891-44b8-4d54-a535-2a7b0261a03b 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:49:59 devstack sudo[93509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-62048891-44b8-4d54-a535-2a7b0261a03b 1073741824 Apr 29 06:49:59 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:49:59 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211ee3f5-6763-40b3-bdf0-482c7f9363f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fb3f730-be84-4206-8e6d-fa00b542278c', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:59 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb185b7e-5995-468e-adea-677e8e1c5245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:49:59 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Volume volume-6fb3f730-be84-4206-8e6d-fa00b542278c (6fb3f730-be84-4206-8e6d-fa00b542278c): created successfully Apr 29 06:49:59 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb185b7e-5995-468e-adea-677e8e1c5245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:49:59 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Flow 'volume_create_manager' (4339f282-2308-4143-bc77-40ddef0cc1ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:49:59 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-1262110c-70f6-4d9f-813b-c5b014c48ea6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Created volume successfully. Apr 29 06:50:00 devstack sudo[93506]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-72c39369-15a2-43fa-a871-a78b0fe31f6e tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.7f8e932f-9009-42ec-8ed5-102f56e0967a" returned: 0 in 0.705s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-72c39369-15a2-43fa-a871-a78b0fe31f6e tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.7f8e932f-9009-42ec-8ed5-102f56e0967a {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:00 devstack sudo[93514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.7f8e932f-9009-42ec-8ed5-102f56e0967a Apr 29 06:50:00 devstack sudo[93514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:00 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-62048891-44b8-4d54-a535-2a7b0261a03b 1073741824" returned: 0 in 0.829s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-62048891-44b8-4d54-a535-2a7b0261a03b {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:00 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-62048891-44b8-4d54-a535-2a7b0261a03b Apr 29 06:50:00 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:00 devstack sudo[93514]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-72c39369-15a2-43fa-a871-a78b0fe31f6e tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f.7f8e932f-9009-42ec-8ed5-102f56e0967a" returned: 0 in 0.620s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-72c39369-15a2-43fa-a871-a78b0fe31f6e tempest-VolumeDependencyTests-709056386 None] Lock "cinder-quobyte-7f8e932f-9009-42ec-8ed5-102f56e0967a" released by "_delete_snapshot" :: held 2.891s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-72c39369-15a2-43fa-a871-a78b0fe31f6e tempest-VolumeDependencyTests-709056386 None] Lock "cinder-quobyte-54128a7b-6c6f-40c6-8f74-2834dc76864f" released by "delete_snapshot" :: held 2.915s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:00 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-72c39369-15a2-43fa-a871-a78b0fe31f6e tempest-VolumeDependencyTests-709056386 None] Created reservations ['0f6956fd-605b-436d-accd-d714523453eb', '640ed7f8-5364-445c-b3b0-6e4b6ea56722', '9df222eb-d1fd-4033-a7fa-a686b7383041', 'cd943046-91fb-4f03-b29d-17ff2a2cd514'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:50:00 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-72c39369-15a2-43fa-a871-a78b0fe31f6e tempest-VolumeDependencyTests-709056386 None] Delete snapshot completed successfully. Apr 29 06:50:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-72c39369-15a2-43fa-a871-a78b0fe31f6e tempest-VolumeDependencyTests-709056386 None] Lock "cinder-7f8e932f-9009-42ec-8ed5-102f56e0967a-delete_snapshot" released by "delete_snapshot" :: held 3.051s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:01 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7d07fd46-0850-4955-9649-d734f00b773b tempest-VolumeDependencyTests-709056386 None] Acquiring lock "cinder-54128a7b-6c6f-40c6-8f74-2834dc76864f-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:01 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7d07fd46-0850-4955-9649-d734f00b773b tempest-VolumeDependencyTests-709056386 None] Lock "cinder-54128a7b-6c6f-40c6-8f74-2834dc76864f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:01 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7d07fd46-0850-4955-9649-d734f00b773b tempest-VolumeDependencyTests-709056386 None] Acquiring lock "cinder-quobyte-54128a7b-6c6f-40c6-8f74-2834dc76864f" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:01 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7d07fd46-0850-4955-9649-d734f00b773b tempest-VolumeDependencyTests-709056386 None] Lock "cinder-quobyte-54128a7b-6c6f-40c6-8f74-2834dc76864f" acquired by "delete_volume" :: waited 0.017s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:01 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[55dc175e-2d60-4332-9f14-d589cbed3ad0]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7d07fd46-0850-4955-9649-d734f00b773b tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:01 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-62048891-44b8-4d54-a535-2a7b0261a03b" returned: 0 in 0.632s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:01 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:50:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.582s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:01 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-705740107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408dd9b6-dafc-4794-997e-fcc9dd1f2548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb6727e6db924ee09fc3e7750334117d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:49Z,use_quota=True,user_id='9885cfc171114c7a93afbc2c6f918ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:50:01 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Creating volume 408dd9b6-dafc-4794-997e-fcc9dd1f2548 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:50:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:01 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:01 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:01 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:50:01 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:50:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-408dd9b6-dafc-4794-997e-fcc9dd1f2548 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:01 devstack sudo[93528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-408dd9b6-dafc-4794-997e-fcc9dd1f2548 1073741824 Apr 29 06:50:01 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b309fe-cce3-4cb1-b8fe-8f973ecd53ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62048891-44b8-4d54-a535-2a7b0261a03b', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:01 devstack sudo[93528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:01 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389b562e-18f9-44f8-8d55-dd3080c2b984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:01 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Volume volume-62048891-44b8-4d54-a535-2a7b0261a03b (62048891-44b8-4d54-a535-2a7b0261a03b): created successfully Apr 29 06:50:01 devstack sudo[93527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f Apr 29 06:50:01 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389b562e-18f9-44f8-8d55-dd3080c2b984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:01 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:01 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Flow 'volume_create_manager' (060c4b15-35dd-4e9e-b3e3-0ff75ab7399a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:50:01 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-8b278947-2ca7-424b-8a07-1112b89450df tempest-CreateVolumesFromSnapshotTest-1486202130 None] Created volume successfully. Apr 29 06:50:01 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7d07fd46-0850-4955-9649-d734f00b773b tempest-VolumeDependencyTests-709056386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f" returned: 0 in 0.740s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7d07fd46-0850-4955-9649-d734f00b773b tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:01 devstack sudo[93538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f Apr 29 06:50:01 devstack sudo[93538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:02 devstack sudo[93528]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-408dd9b6-dafc-4794-997e-fcc9dd1f2548 1073741824" returned: 0 in 0.786s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-408dd9b6-dafc-4794-997e-fcc9dd1f2548 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:02 devstack sudo[93540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-408dd9b6-dafc-4794-997e-fcc9dd1f2548 Apr 29 06:50:02 devstack sudo[93540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:02 devstack sudo[93538]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7d07fd46-0850-4955-9649-d734f00b773b tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-54128a7b-6c6f-40c6-8f74-2834dc76864f" returned: 0 in 0.631s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:02 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7d07fd46-0850-4955-9649-d734f00b773b tempest-VolumeDependencyTests-709056386 None] Lock "cinder-quobyte-54128a7b-6c6f-40c6-8f74-2834dc76864f" released by "delete_volume" :: held 1.426s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:02 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-7d07fd46-0850-4955-9649-d734f00b773b tempest-VolumeDependencyTests-709056386 None] Created reservations ['a3b46a43-a08b-44ac-9b7f-2bdc1219dd2f', '9c816b6e-5a1b-4bdb-bd06-a57f4b03eb56', '78cebf7c-fa43-448b-8210-03617053e41c', '01c224ba-1abc-4e5c-8d46-e687dace4052'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:50:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7d07fd46-0850-4955-9649-d734f00b773b tempest-VolumeDependencyTests-709056386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7d07fd46-0850-4955-9649-d734f00b773b tempest-VolumeDependencyTests-709056386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:02 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-7d07fd46-0850-4955-9649-d734f00b773b tempest-VolumeDependencyTests-709056386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:02 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-7d07fd46-0850-4955-9649-d734f00b773b tempest-VolumeDependencyTests-709056386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7d07fd46-0850-4955-9649-d734f00b773b tempest-VolumeDependencyTests-709056386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:02 devstack sudo[93540]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7d07fd46-0850-4955-9649-d734f00b773b tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-408dd9b6-dafc-4794-997e-fcc9dd1f2548" returned: 0 in 0.624s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:02 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:50:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.559s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:02 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-883771764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d526c3e7-ae1f-46ad-88e0-a4a86c577f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb6727e6db924ee09fc3e7750334117d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:50Z,use_quota=True,user_id='9885cfc171114c7a93afbc2c6f918ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:50:02 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Creating volume d526c3e7-ae1f-46ad-88e0-a4a86c577f1d {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:50:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:02 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:02 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:50:02 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:02 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:02 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:50:02 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:50:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d526c3e7-ae1f-46ad-88e0-a4a86c577f1d 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:02 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dafbbf0-24f1-423e-a728-a6c765a1a18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-408dd9b6-dafc-4794-997e-fcc9dd1f2548', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:02 devstack sudo[93546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d526c3e7-ae1f-46ad-88e0-a4a86c577f1d 1073741824 Apr 29 06:50:02 devstack sudo[93546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:02 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ed9b071-fce4-4f04-a46c-b2001a2b9364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:02 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Volume volume-408dd9b6-dafc-4794-997e-fcc9dd1f2548 (408dd9b6-dafc-4794-997e-fcc9dd1f2548): created successfully Apr 29 06:50:02 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ed9b071-fce4-4f04-a46c-b2001a2b9364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:02 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Flow 'volume_create_manager' (7da749ce-c513-4129-922a-a89ce50dccd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:50:02 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-f01946d5-8fff-4b1e-816d-72b753a830a8 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Created volume successfully. Apr 29 06:50:03 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7d07fd46-0850-4955-9649-d734f00b773b tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.662s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:03 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-7d07fd46-0850-4955-9649-d734f00b773b tempest-VolumeDependencyTests-709056386 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:50:03 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-7d07fd46-0850-4955-9649-d734f00b773b tempest-VolumeDependencyTests-709056386 None] Deleted volume successfully. Apr 29 06:50:03 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7d07fd46-0850-4955-9649-d734f00b773b tempest-VolumeDependencyTests-709056386 None] Lock "cinder-54128a7b-6c6f-40c6-8f74-2834dc76864f-delete_volume" released by "delete_volume" :: held 2.296s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:03 devstack sudo[93546]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d526c3e7-ae1f-46ad-88e0-a4a86c577f1d 1073741824" returned: 0 in 0.846s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d526c3e7-ae1f-46ad-88e0-a4a86c577f1d {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:03 devstack sudo[93553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d526c3e7-ae1f-46ad-88e0-a4a86c577f1d Apr 29 06:50:03 devstack sudo[93553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:03 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:50:03 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Flow 'volume_create_manager' (0029821c-699f-47ea-ad1f-a84719a330a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:50:03 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1182abab-6b67-44f8-9a28-b16f20c78130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:03 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1182abab-6b67-44f8-9a28-b16f20c78130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1285237868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af062e96-d99b-4d11-bdcf-9496d14eb893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace88f2823a14804b1907c40d5824803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:50:04Z,use_quota=True,user_id='571613088c0d4fe6b2c336497496a0fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:03 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65d2e68-82df-496a-bf4e-9a4de1aeb605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:03 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65d2e68-82df-496a-bf4e-9a4de1aeb605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:03 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa2e3c4d-3f5a-4054-9ddd-1b5b5a27ee7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:03 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa2e3c4d-3f5a-4054-9ddd-1b5b5a27ee7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af062e96-d99b-4d11-bdcf-9496d14eb893', 'volume_name': 'volume-af062e96-d99b-4d11-bdcf-9496d14eb893', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:03 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c05b34-1717-4f7e-a2ec-87d0623e273e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:03 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c05b34-1717-4f7e-a2ec-87d0623e273e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:03 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a93548dd-16b4-4373-b5bc-31dad9325f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:03 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Volume af062e96-d99b-4d11-bdcf-9496d14eb893: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af062e96-d99b-4d11-bdcf-9496d14eb893', 'volume_size': 1} Apr 29 06:50:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:04 devstack sudo[93553]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d526c3e7-ae1f-46ad-88e0-a4a86c577f1d" returned: 0 in 0.589s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:50:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.608s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-940273821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6359c89-ba9b-46a2-b605-d9300aaadef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d249a88184f4b94a41c862a9a3d838f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:50Z,use_quota=True,user_id='3a10b2896b124a3dbb43c7705bb0fac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:50:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Creating volume e6359c89-ba9b-46a2-b605-d9300aaadef7 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:50:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:50:04 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:50:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d46f2c-4072-467c-a0d7-4330ade3366d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d526c3e7-ae1f-46ad-88e0-a4a86c577f1d', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:04 devstack sudo[93556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7 1073741824 Apr 29 06:50:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e0dea6-3b7f-44dd-9b80-67941aabd93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:04 devstack sudo[93556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:04 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Volume volume-d526c3e7-ae1f-46ad-88e0-a4a86c577f1d (d526c3e7-ae1f-46ad-88e0-a4a86c577f1d): created successfully Apr 29 06:50:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e0dea6-3b7f-44dd-9b80-67941aabd93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:04 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Flow 'volume_create_manager' (84a3d584-0d6e-4d9e-8ff4-49116ff32c6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:50:04 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-5e835b9e-a932-4e0f-8a16-369a73c4ad70 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Created volume successfully. Apr 29 06:50:04 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c021e73d-3899-4a58-aad6-0742dcc02af6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "cinder-d526c3e7-ae1f-46ad-88e0-a4a86c577f1d-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:04 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c021e73d-3899-4a58-aad6-0742dcc02af6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-d526c3e7-ae1f-46ad-88e0-a4a86c577f1d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:04 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c021e73d-3899-4a58-aad6-0742dcc02af6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "cinder-quobyte-d526c3e7-ae1f-46ad-88e0-a4a86c577f1d" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:04 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c021e73d-3899-4a58-aad6-0742dcc02af6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-quobyte-d526c3e7-ae1f-46ad-88e0-a4a86c577f1d" acquired by "delete_volume" :: waited 0.016s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:04 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40e150f-9e8d-4a36-bf35-e78185d2bd96]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c021e73d-3899-4a58-aad6-0742dcc02af6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d526c3e7-ae1f-46ad-88e0-a4a86c577f1d {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:04 devstack sudo[93558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d526c3e7-ae1f-46ad-88e0-a4a86c577f1d Apr 29 06:50:04 devstack sudo[93558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:05 devstack sudo[93556]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7 1073741824" returned: 0 in 0.792s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:05 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7 Apr 29 06:50:05 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:05 devstack sudo[93558]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c021e73d-3899-4a58-aad6-0742dcc02af6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d526c3e7-ae1f-46ad-88e0-a4a86c577f1d" returned: 0 in 0.748s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c021e73d-3899-4a58-aad6-0742dcc02af6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d526c3e7-ae1f-46ad-88e0-a4a86c577f1d {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:05 devstack sudo[93568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d526c3e7-ae1f-46ad-88e0-a4a86c577f1d Apr 29 06:50:05 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:05 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7" returned: 0 in 0.616s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.998s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1147217046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8737439d-cec9-4fa7-a157-8b04b5838532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd1f691a145456db8e139d2c27a22b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:49:56Z,use_quota=True,user_id='db7ed9321fca423e89016a187ead5008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Creating volume 8737439d-cec9-4fa7-a157-8b04b5838532 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:50:05 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8737439d-cec9-4fa7-a157-8b04b5838532 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:UPDATE=120,cinder:SELECT=96,cinder:DELETE=12,cinder:INSERT=25 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:50:05 devstack sudo[93571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8737439d-cec9-4fa7-a157-8b04b5838532 1073741824 Apr 29 06:50:05 devstack sudo[93571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b38a6e-d5fb-4c1c-9f0d-e1715dceb779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6359c89-ba9b-46a2-b605-d9300aaadef7', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb334c9c-6a5d-40ed-acfe-7afb536b276d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:05 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Volume volume-e6359c89-ba9b-46a2-b605-d9300aaadef7 (e6359c89-ba9b-46a2-b605-d9300aaadef7): created successfully Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb334c9c-6a5d-40ed-acfe-7afb536b276d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Flow 'volume_create_manager' (27d4830d-853c-41e2-8b6e-9a0621b6e48d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:50:05 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-c15b91e6-81f9-4cfd-9e21-45b0df001188 tempest-SnapshotDependencyTests-1048922672 None] Created volume successfully. Apr 29 06:50:05 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c021e73d-3899-4a58-aad6-0742dcc02af6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-d526c3e7-ae1f-46ad-88e0-a4a86c577f1d" returned: 0 in 0.605s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c021e73d-3899-4a58-aad6-0742dcc02af6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-quobyte-d526c3e7-ae1f-46ad-88e0-a4a86c577f1d" released by "delete_volume" :: held 1.403s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-c021e73d-3899-4a58-aad6-0742dcc02af6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Created reservations ['fe2642ce-2a18-4038-8d34-58d4bdff70e6', 'a897a2f0-9af7-441d-9cf8-97a6107ef524', 'cf4fcd3d-332c-4f2a-ac0d-b567acc74411', '20ada9aa-79e7-480f-a121-6ae4635141f1'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c021e73d-3899-4a58-aad6-0742dcc02af6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c021e73d-3899-4a58-aad6-0742dcc02af6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c021e73d-3899-4a58-aad6-0742dcc02af6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c021e73d-3899-4a58-aad6-0742dcc02af6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c021e73d-3899-4a58-aad6-0742dcc02af6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c021e73d-3899-4a58-aad6-0742dcc02af6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:06 devstack sudo[93574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:50:06 devstack sudo[93574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:06 devstack sudo[93571]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8737439d-cec9-4fa7-a157-8b04b5838532 1073741824" returned: 0 in 0.856s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8737439d-cec9-4fa7-a157-8b04b5838532 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:06 devstack sudo[93581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8737439d-cec9-4fa7-a157-8b04b5838532 Apr 29 06:50:06 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:06 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8a90e062-37a9-4f36-957a-443c7c581e13 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "cinder-408dd9b6-dafc-4794-997e-fcc9dd1f2548-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:06 devstack sudo[93574]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c021e73d-3899-4a58-aad6-0742dcc02af6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.705s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:06 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-c021e73d-3899-4a58-aad6-0742dcc02af6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:50:06 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8a90e062-37a9-4f36-957a-443c7c581e13 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-408dd9b6-dafc-4794-997e-fcc9dd1f2548-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:06 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-c021e73d-3899-4a58-aad6-0742dcc02af6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Deleted volume successfully. Apr 29 06:50:06 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c021e73d-3899-4a58-aad6-0742dcc02af6 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-d526c3e7-ae1f-46ad-88e0-a4a86c577f1d-delete_volume" released by "delete_volume" :: held 2.317s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:06 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8a90e062-37a9-4f36-957a-443c7c581e13 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "cinder-quobyte-408dd9b6-dafc-4794-997e-fcc9dd1f2548" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:06 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8a90e062-37a9-4f36-957a-443c7c581e13 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-quobyte-408dd9b6-dafc-4794-997e-fcc9dd1f2548" acquired by "delete_volume" :: waited 0.015s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:06 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb95082-9ea3-43e6-a8cb-b05e32dd1553]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:06 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8a90e062-37a9-4f36-957a-443c7c581e13 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-408dd9b6-dafc-4794-997e-fcc9dd1f2548 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:06 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-408dd9b6-dafc-4794-997e-fcc9dd1f2548 Apr 29 06:50:06 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-822311c7-01ac-4f0a-b24f-f4118142373f tempest-SnapshotDependencyTests-1048922672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:07 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8737439d-cec9-4fa7-a157-8b04b5838532" returned: 0 in 0.718s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:07 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:50:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.500s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:07 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1285237868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af062e96-d99b-4d11-bdcf-9496d14eb893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace88f2823a14804b1907c40d5824803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:50:04Z,use_quota=True,user_id='571613088c0d4fe6b2c336497496a0fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:50:07 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Creating volume af062e96-d99b-4d11-bdcf-9496d14eb893 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:50:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:07 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:07 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:07 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:50:07 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:50:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:07 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac71f43-ed20-4ea5-81e1-cd7f2bbc2287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8737439d-cec9-4fa7-a157-8b04b5838532', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:07 devstack sudo[93587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893 1073741824 Apr 29 06:50:07 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e808475a-60f4-4d09-b2a7-7a2412b6a5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:07 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:07 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Volume volume-8737439d-cec9-4fa7-a157-8b04b5838532 (8737439d-cec9-4fa7-a157-8b04b5838532): created successfully Apr 29 06:50:07 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e808475a-60f4-4d09-b2a7-7a2412b6a5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:07 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Flow 'volume_create_manager' (6c2093e9-2a8b-402b-868a-0dd634721215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:50:07 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-2da74587-eb6a-4d78-b849-0eefe105ab89 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Created volume successfully. Apr 29 06:50:07 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8a90e062-37a9-4f36-957a-443c7c581e13 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-408dd9b6-dafc-4794-997e-fcc9dd1f2548" returned: 0 in 0.754s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:07 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8a90e062-37a9-4f36-957a-443c7c581e13 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-408dd9b6-dafc-4794-997e-fcc9dd1f2548 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:07 devstack sudo[93592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-408dd9b6-dafc-4794-997e-fcc9dd1f2548 Apr 29 06:50:07 devstack sudo[93592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:08 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893 1073741824" returned: 0 in 0.809s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:08 devstack sudo[93599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893 Apr 29 06:50:08 devstack sudo[93599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:08 devstack sudo[93592]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8a90e062-37a9-4f36-957a-443c7c581e13 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-408dd9b6-dafc-4794-997e-fcc9dd1f2548" returned: 0 in 0.655s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8a90e062-37a9-4f36-957a-443c7c581e13 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-quobyte-408dd9b6-dafc-4794-997e-fcc9dd1f2548" released by "delete_volume" :: held 1.460s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-8a90e062-37a9-4f36-957a-443c7c581e13 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Created reservations ['456b07e7-277f-4d30-a952-8d31c5cd1fdd', '29f794c3-716c-4383-ade9-b04f5f4c097d', '2ab166cf-9e0f-4227-82cf-9b80cc7a7707', 'c0adc7c2-3837-4698-a964-8fcfd1526af3'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8a90e062-37a9-4f36-957a-443c7c581e13 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8a90e062-37a9-4f36-957a-443c7c581e13 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8a90e062-37a9-4f36-957a-443c7c581e13 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8a90e062-37a9-4f36-957a-443c7c581e13 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8a90e062-37a9-4f36-957a-443c7c581e13 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8a90e062-37a9-4f36-957a-443c7c581e13 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:08 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:50:08 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Flow 'volume_create_manager' (0b3eacd3-7325-428f-9839-8b5097c9dd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b73fe62-656a-4a3b-a50b-9ae8d566932a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:08 devstack sudo[93599]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893" returned: 0 in 0.707s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b73fe62-656a-4a3b-a50b-9ae8d566932a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1889121268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b875f9d4-87ec-4be3-b275-65829401cfb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd1f691a145456db8e139d2c27a22b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:50:09Z,use_quota=True,user_id='db7ed9321fca423e89016a187ead5008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adfb0f04-ed58-46a3-9225-1ab56d74a119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adfb0f04-ed58-46a3-9225-1ab56d74a119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf52115-3a8b-4949-be0b-421cc84d62bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf52115-3a8b-4949-be0b-421cc84d62bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b875f9d4-87ec-4be3-b275-65829401cfb0', 'volume_name': 'volume-b875f9d4-87ec-4be3-b275-65829401cfb0', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cc2ee94-cabd-4dc2-a75a-96f718006e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cc2ee94-cabd-4dc2-a75a-96f718006e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46703963-8d7a-4d8c-85ed-a5917f196df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:08 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Volume b875f9d4-87ec-4be3-b275-65829401cfb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b875f9d4-87ec-4be3-b275-65829401cfb0', 'volume_size': 1} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1889121268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b875f9d4-87ec-4be3-b275-65829401cfb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd1f691a145456db8e139d2c27a22b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:50:09Z,use_quota=True,user_id='db7ed9321fca423e89016a187ead5008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Creating volume b875f9d4-87ec-4be3-b275-65829401cfb0 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:50:08 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:50:08 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b875f9d4-87ec-4be3-b275-65829401cfb0 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4da2b266-30eb-48a1-b1d7-338361705e03 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "cinder-62048891-44b8-4d54-a535-2a7b0261a03b-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:09 devstack sudo[93605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b875f9d4-87ec-4be3-b275-65829401cfb0 1073741824 Apr 29 06:50:09 devstack sudo[93605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a93548dd-16b4-4373-b5bc-31dad9325f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af062e96-d99b-4d11-bdcf-9496d14eb893', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396dc317-1d7b-4f73-bbfd-d55b94204da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4da2b266-30eb-48a1-b1d7-338361705e03 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-62048891-44b8-4d54-a535-2a7b0261a03b-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:09 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8a90e062-37a9-4f36-957a-443c7c581e13 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.790s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-8a90e062-37a9-4f36-957a-443c7c581e13 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:50:09 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Volume volume-af062e96-d99b-4d11-bdcf-9496d14eb893 (af062e96-d99b-4d11-bdcf-9496d14eb893): created successfully Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396dc317-1d7b-4f73-bbfd-d55b94204da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Flow 'volume_create_manager' (0029821c-699f-47ea-ad1f-a84719a330a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:50:09 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-8a90e062-37a9-4f36-957a-443c7c581e13 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Deleted volume successfully. Apr 29 06:50:09 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-4ec75ba0-e4d5-40d4-a4ed-445f2b37ba40 tempest-VolumeDependencyTests-709056386 None] Created volume successfully. Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-8a90e062-37a9-4f36-957a-443c7c581e13 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-408dd9b6-dafc-4794-997e-fcc9dd1f2548-delete_volume" released by "delete_volume" :: held 2.528s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4da2b266-30eb-48a1-b1d7-338361705e03 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "cinder-quobyte-62048891-44b8-4d54-a535-2a7b0261a03b" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Flow 'volume_create_manager' (57f6c074-2cdc-4e9b-8c0d-aa7f4208d22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc1d3ab1-78d2-4e35-8fd2-6fa67ee18448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4da2b266-30eb-48a1-b1d7-338361705e03 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-quobyte-62048891-44b8-4d54-a535-2a7b0261a03b" acquired by "delete_volume" :: waited 0.047s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc1d3ab1-78d2-4e35-8fd2-6fa67ee18448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1009218838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c79301df-4664-4082-ab8b-d2458959853e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd1f691a145456db8e139d2c27a22b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:50:09Z,use_quota=True,user_id='db7ed9321fca423e89016a187ead5008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f566650-bd89-4c90-bc9c-067456d1eef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f566650-bd89-4c90-bc9c-067456d1eef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87924e13-6f10-4d51-b777-a9f6882beb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87924e13-6f10-4d51-b777-a9f6882beb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c79301df-4664-4082-ab8b-d2458959853e', 'volume_name': 'volume-c79301df-4664-4082-ab8b-d2458959853e', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3357e446-c912-4e61-981a-83ea04f96a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3357e446-c912-4e61-981a-83ea04f96a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c6bdcb4-70ab-47f6-8a91-4e51d060e6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:09 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Volume c79301df-4664-4082-ab8b-d2458959853e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c79301df-4664-4082-ab8b-d2458959853e', 'volume_size': 1} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40ebbae-c6a6-42a3-9d65-0b05ca95950a]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4da2b266-30eb-48a1-b1d7-338361705e03 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-62048891-44b8-4d54-a535-2a7b0261a03b {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:09 devstack sudo[93607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-62048891-44b8-4d54-a535-2a7b0261a03b Apr 29 06:50:09 devstack sudo[93607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Flow 'volume_create_manager' (979c1406-c61e-4f52-8d93-9216350830bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ffcdd0-28c3-486b-900d-f3a3ebb4a048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ffcdd0-28c3-486b-900d-f3a3ebb4a048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2000607083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed06d585-3f17-4175-b3d2-e2145c6cdceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd1f691a145456db8e139d2c27a22b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:50:10Z,use_quota=True,user_id='db7ed9321fca423e89016a187ead5008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26647cae-1e07-4a9b-bdea-fa494d1ab597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26647cae-1e07-4a9b-bdea-fa494d1ab597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b0ff42e-e83e-446c-8e87-a5951a5c39a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b0ff42e-e83e-446c-8e87-a5951a5c39a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed06d585-3f17-4175-b3d2-e2145c6cdceb', 'volume_name': 'volume-ed06d585-3f17-4175-b3d2-e2145c6cdceb', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f70ff66b-84e4-4112-8c01-5623fbea8993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f70ff66b-84e4-4112-8c01-5623fbea8993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749e3a34-6728-4002-b511-ad800c85be0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:09 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Volume ed06d585-3f17-4175-b3d2-e2145c6cdceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed06d585-3f17-4175-b3d2-e2145c6cdceb', 'volume_size': 1} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Flow 'volume_create_manager' (048a1e13-2355-49c1-bc0f-802d7d4dc52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (584258fe-541f-43db-b4b2-65125cddb724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:09 devstack sudo[93605]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b875f9d4-87ec-4be3-b275-65829401cfb0 1073741824" returned: 0 in 0.995s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:09 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (584258fe-541f-43db-b4b2-65125cddb724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-41035465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80cc0294-be65-499c-8cc5-690f5161e997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd1f691a145456db8e139d2c27a22b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:50:10Z,use_quota=True,user_id='db7ed9321fca423e89016a187ead5008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f58a908-700c-4d5d-94a4-c821137df489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f58a908-700c-4d5d-94a4-c821137df489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (859d277d-b3d9-4f6a-bd4f-046489790f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (859d277d-b3d9-4f6a-bd4f-046489790f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80cc0294-be65-499c-8cc5-690f5161e997', 'volume_name': 'volume-80cc0294-be65-499c-8cc5-690f5161e997', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb4ab05-2e26-4b1b-bf0c-d49934cfd339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb4ab05-2e26-4b1b-bf0c-d49934cfd339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc2eea44-47fe-454b-bdf6-ef1f07093149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:10 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Volume 80cc0294-be65-499c-8cc5-690f5161e997: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80cc0294-be65-499c-8cc5-690f5161e997', 'volume_size': 1} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b875f9d4-87ec-4be3-b275-65829401cfb0 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:10 devstack sudo[93616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b875f9d4-87ec-4be3-b275-65829401cfb0 Apr 29 06:50:10 devstack sudo[93616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:10 devstack sudo[93607]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4da2b266-30eb-48a1-b1d7-338361705e03 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-62048891-44b8-4d54-a535-2a7b0261a03b" returned: 0 in 0.865s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4da2b266-30eb-48a1-b1d7-338361705e03 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-62048891-44b8-4d54-a535-2a7b0261a03b {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:10 devstack sudo[93618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-62048891-44b8-4d54-a535-2a7b0261a03b Apr 29 06:50:10 devstack sudo[93618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Flow 'volume_create_manager' (e2070b6a-7871-4286-be07-d1d31a42aa0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a623a1-eb33-47ad-9e9f-ba0fe05cb95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a623a1-eb33-47ad-9e9f-ba0fe05cb95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-992151184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5707946c-8576-46b2-88dd-de64c11a305a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd1f691a145456db8e139d2c27a22b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:50:10Z,use_quota=True,user_id='db7ed9321fca423e89016a187ead5008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f3722c-8937-4dd6-8c3c-20e4b9dc67cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f3722c-8937-4dd6-8c3c-20e4b9dc67cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed3fa8aa-cbc0-4d89-87b1-96cd6884ef62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed3fa8aa-cbc0-4d89-87b1-96cd6884ef62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5707946c-8576-46b2-88dd-de64c11a305a', 'volume_name': 'volume-5707946c-8576-46b2-88dd-de64c11a305a', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f1acb0-9383-4790-90d1-6c4f2da5fe52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f1acb0-9383-4790-90d1-6c4f2da5fe52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8753082-586a-4777-a046-03a1833a6a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:10 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Volume 5707946c-8576-46b2-88dd-de64c11a305a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5707946c-8576-46b2-88dd-de64c11a305a', 'volume_size': 1} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Flow 'volume_create_manager' (186451da-8bd0-4d22-8c1c-ff80ff555bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169119cc-5cb9-4233-b650-9f85fb052ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169119cc-5cb9-4233-b650-9f85fb052ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-928092742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dba58833-4e73-483e-a2dc-1772f964284c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace88f2823a14804b1907c40d5824803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=af062e96-d99b-4d11-bdcf-9496d14eb893,status='creating',terminated_at=None,updated_at=2026-04-29T04:50:11Z,use_quota=True,user_id='571613088c0d4fe6b2c336497496a0fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:10 devstack sudo[93616]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1fbc31e-912d-4d4e-80ce-27b1febad57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1fbc31e-912d-4d4e-80ce-27b1febad57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93a8f472-6f09-4329-a38a-821bbd1c95ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b875f9d4-87ec-4be3-b275-65829401cfb0" returned: 0 in 0.691s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-822311c7-01ac-4f0a-b24f-f4118142373f tempest-SnapshotDependencyTests-1048922672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.759s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-822311c7-01ac-4f0a-b24f-f4118142373f tempest-SnapshotDependencyTests-1048922672 None] Creating offline snapshot 3ae16046-ce72-47d3-a8eb-a229a7d29c46 of volume e6359c89-ba9b-46a2-b605-d9300aaadef7 {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93a8f472-6f09-4329-a38a-821bbd1c95ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'dba58833-4e73-483e-a2dc-1772f964284c', 'volume_name': 'volume-dba58833-4e73-483e-a2dc-1772f964284c', 'volume_size': 1, 'source_volid': 'af062e96-d99b-4d11-bdcf-9496d14eb893', 'source_volstatus': 'available'}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e444fd63-88f4-40ec-9262-2eede52e0f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e444fd63-88f4-40ec-9262-2eede52e0f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a5970aa-ce84-48ee-970b-1cce738249ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:10 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Volume dba58833-4e73-483e-a2dc-1772f964284c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-dba58833-4e73-483e-a2dc-1772f964284c', 'volume_size': 1, 'source_volid': 'af062e96-d99b-4d11-bdcf-9496d14eb893', 'source_volstatus': 'available'} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[87edfb74-9aca-4794-9fbe-3559dddea023]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46703963-8d7a-4d8c-85ed-a5917f196df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b875f9d4-87ec-4be3-b275-65829401cfb0', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12359eed-7ca5-4f71-a567-46342e0e8dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-822311c7-01ac-4f0a-b24f-f4118142373f tempest-SnapshotDependencyTests-1048922672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:10 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Volume volume-b875f9d4-87ec-4be3-b275-65829401cfb0 (b875f9d4-87ec-4be3-b275-65829401cfb0): created successfully Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12359eed-7ca5-4f71-a567-46342e0e8dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Flow 'volume_create_manager' (0b3eacd3-7325-428f-9839-8b5097c9dd13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:50:10 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-b7bcd499-7726-4125-9497-a01655b6f620 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Created volume successfully. Apr 29 06:50:10 devstack sudo[93622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7 Apr 29 06:50:10 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:10 devstack sudo[93618]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4da2b266-30eb-48a1-b1d7-338361705e03 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-62048891-44b8-4d54-a535-2a7b0261a03b" returned: 0 in 0.755s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:10 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4da2b266-30eb-48a1-b1d7-338361705e03 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-quobyte-62048891-44b8-4d54-a535-2a7b0261a03b" released by "delete_volume" :: held 1.710s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:11 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-4da2b266-30eb-48a1-b1d7-338361705e03 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Created reservations ['47208e53-79ed-44e7-a033-700fc5ba5767', '495f9bea-e2e8-47a2-b3d6-25b7086014ac', 'baf39854-7ca8-4f16-a542-974290ff7689', '2bfc5292-32b7-4ab0-a73a-fa9c88ef67a9'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:50:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4da2b266-30eb-48a1-b1d7-338361705e03 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4da2b266-30eb-48a1-b1d7-338361705e03 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:11 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4da2b266-30eb-48a1-b1d7-338361705e03 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:11 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4da2b266-30eb-48a1-b1d7-338361705e03 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4da2b266-30eb-48a1-b1d7-338361705e03 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4da2b266-30eb-48a1-b1d7-338361705e03 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:11 devstack sudo[93624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:50:11 devstack sudo[93624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:11 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-090d71a4-4fe2-4ab7-bc9c-61aed751d233 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "cinder-6fb3f730-be84-4206-8e6d-fa00b542278c-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:11 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-090d71a4-4fe2-4ab7-bc9c-61aed751d233 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-6fb3f730-be84-4206-8e6d-fa00b542278c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:11 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-090d71a4-4fe2-4ab7-bc9c-61aed751d233 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "cinder-quobyte-6fb3f730-be84-4206-8e6d-fa00b542278c" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:11 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-090d71a4-4fe2-4ab7-bc9c-61aed751d233 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-quobyte-6fb3f730-be84-4206-8e6d-fa00b542278c" acquired by "delete_volume" :: waited 0.016s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:11 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fa401d-4259-4a23-ac50-48e1c704e3a5]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-090d71a4-4fe2-4ab7-bc9c-61aed751d233 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6fb3f730-be84-4206-8e6d-fa00b542278c {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:11 devstack sudo[93626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6fb3f730-be84-4206-8e6d-fa00b542278c Apr 29 06:50:11 devstack sudo[93626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:11 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-822311c7-01ac-4f0a-b24f-f4118142373f tempest-SnapshotDependencyTests-1048922672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7" returned: 0 in 0.823s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-822311c7-01ac-4f0a-b24f-f4118142373f tempest-SnapshotDependencyTests-1048922672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.3ae16046-ce72-47d3-a8eb-a229a7d29c46 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:11 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.3ae16046-ce72-47d3-a8eb-a229a7d29c46 1G Apr 29 06:50:11 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:11 devstack sudo[93624]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:11 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4da2b266-30eb-48a1-b1d7-338361705e03 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.674s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:11 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-4da2b266-30eb-48a1-b1d7-338361705e03 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:50:11 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-4da2b266-30eb-48a1-b1d7-338361705e03 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Deleted volume successfully. Apr 29 06:50:11 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4da2b266-30eb-48a1-b1d7-338361705e03 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-62048891-44b8-4d54-a535-2a7b0261a03b-delete_volume" released by "delete_volume" :: held 2.706s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:12 devstack sudo[93626]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-090d71a4-4fe2-4ab7-bc9c-61aed751d233 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6fb3f730-be84-4206-8e6d-fa00b542278c" returned: 0 in 0.765s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-090d71a4-4fe2-4ab7-bc9c-61aed751d233 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6fb3f730-be84-4206-8e6d-fa00b542278c {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:12 devstack sudo[93637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6fb3f730-be84-4206-8e6d-fa00b542278c Apr 29 06:50:12 devstack sudo[93637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:12 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-822311c7-01ac-4f0a-b24f-f4118142373f tempest-SnapshotDependencyTests-1048922672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.3ae16046-ce72-47d3-a8eb-a229a7d29c46 1G" returned: 0 in 0.800s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-822311c7-01ac-4f0a-b24f-f4118142373f tempest-SnapshotDependencyTests-1048922672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6359c89-ba9b-46a2-b605-d9300aaadef7 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.3ae16046-ce72-47d3-a8eb-a229a7d29c46 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:12 devstack sudo[93642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6359c89-ba9b-46a2-b605-d9300aaadef7 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.3ae16046-ce72-47d3-a8eb-a229a7d29c46 Apr 29 06:50:12 devstack sudo[93642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:12 devstack sudo[93637]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-090d71a4-4fe2-4ab7-bc9c-61aed751d233 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-6fb3f730-be84-4206-8e6d-fa00b542278c" returned: 0 in 0.621s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:12 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-090d71a4-4fe2-4ab7-bc9c-61aed751d233 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-quobyte-6fb3f730-be84-4206-8e6d-fa00b542278c" released by "delete_volume" :: held 1.427s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:12 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-090d71a4-4fe2-4ab7-bc9c-61aed751d233 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Created reservations ['c45162b5-4df1-41e5-8215-affc7bb43a18', '8be5dfc7-93a3-41b6-8bbd-abbf0ed691ff', 'e5309b72-780b-49e8-aee9-916c64d343de', 'dc45038f-4814-4c03-8b53-90affb78cf40'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:50:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-090d71a4-4fe2-4ab7-bc9c-61aed751d233 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-090d71a4-4fe2-4ab7-bc9c-61aed751d233 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:12 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-090d71a4-4fe2-4ab7-bc9c-61aed751d233 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:12 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-090d71a4-4fe2-4ab7-bc9c-61aed751d233 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-090d71a4-4fe2-4ab7-bc9c-61aed751d233 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:12 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-090d71a4-4fe2-4ab7-bc9c-61aed751d233 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:12 devstack sudo[93645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:50:12 devstack sudo[93645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:13 devstack sudo[93642]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-822311c7-01ac-4f0a-b24f-f4118142373f tempest-SnapshotDependencyTests-1048922672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6359c89-ba9b-46a2-b605-d9300aaadef7 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.3ae16046-ce72-47d3-a8eb-a229a7d29c46" returned: 0 in 0.641s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:13 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-822311c7-01ac-4f0a-b24f-f4118142373f tempest-SnapshotDependencyTests-1048922672 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.3ae16046-ce72-47d3-a8eb-a229a7d29c46 is being set with open permissions: ugo+rw Apr 29 06:50:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-822311c7-01ac-4f0a-b24f-f4118142373f tempest-SnapshotDependencyTests-1048922672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.3ae16046-ce72-47d3-a8eb-a229a7d29c46 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:13 devstack sudo[93650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.3ae16046-ce72-47d3-a8eb-a229a7d29c46 Apr 29 06:50:13 devstack sudo[93650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:13 devstack sudo[93645]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:13 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-b6d03f60-0030-4577-9497-c0237c4089c3 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "cinder-68f2b6c7-2455-4fac-983e-dd7c78e79ef3-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-090d71a4-4fe2-4ab7-bc9c-61aed751d233 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.632s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:13 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-090d71a4-4fe2-4ab7-bc9c-61aed751d233 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:50:13 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-b6d03f60-0030-4577-9497-c0237c4089c3 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-68f2b6c7-2455-4fac-983e-dd7c78e79ef3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:13 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-090d71a4-4fe2-4ab7-bc9c-61aed751d233 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Deleted volume successfully. Apr 29 06:50:13 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-090d71a4-4fe2-4ab7-bc9c-61aed751d233 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-6fb3f730-be84-4206-8e6d-fa00b542278c-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:13 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-b6d03f60-0030-4577-9497-c0237c4089c3 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "cinder-quobyte-68f2b6c7-2455-4fac-983e-dd7c78e79ef3" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:13 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-b6d03f60-0030-4577-9497-c0237c4089c3 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-quobyte-68f2b6c7-2455-4fac-983e-dd7c78e79ef3" acquired by "delete_volume" :: waited 0.021s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:13 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[5365b7ef-b5a0-4256-8dce-fa89695b5a82]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b6d03f60-0030-4577-9497-c0237c4089c3 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-68f2b6c7-2455-4fac-983e-dd7c78e79ef3 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:13 devstack sudo[93653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-68f2b6c7-2455-4fac-983e-dd7c78e79ef3 Apr 29 06:50:13 devstack sudo[93653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:13 devstack sudo[93650]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-822311c7-01ac-4f0a-b24f-f4118142373f tempest-SnapshotDependencyTests-1048922672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.3ae16046-ce72-47d3-a8eb-a229a7d29c46" returned: 0 in 0.622s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:13 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-822311c7-01ac-4f0a-b24f-f4118142373f tempest-SnapshotDependencyTests-1048922672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:13 devstack sudo[93656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.info Apr 29 06:50:13 devstack sudo[93656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:14 devstack sudo[93653]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b6d03f60-0030-4577-9497-c0237c4089c3 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-68f2b6c7-2455-4fac-983e-dd7c78e79ef3" returned: 0 in 0.712s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b6d03f60-0030-4577-9497-c0237c4089c3 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-68f2b6c7-2455-4fac-983e-dd7c78e79ef3 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:14 devstack sudo[93661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-68f2b6c7-2455-4fac-983e-dd7c78e79ef3 Apr 29 06:50:14 devstack sudo[93661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:14 devstack sudo[93656]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-822311c7-01ac-4f0a-b24f-f4118142373f tempest-SnapshotDependencyTests-1048922672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.info" returned: 0 in 0.597s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:14 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-822311c7-01ac-4f0a-b24f-f4118142373f tempest-SnapshotDependencyTests-1048922672 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.info is being set with open permissions: ugo+rw Apr 29 06:50:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-822311c7-01ac-4f0a-b24f-f4118142373f tempest-SnapshotDependencyTests-1048922672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:14 devstack sudo[93664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.info Apr 29 06:50:14 devstack sudo[93664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:14 devstack sudo[93661]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b6d03f60-0030-4577-9497-c0237c4089c3 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-68f2b6c7-2455-4fac-983e-dd7c78e79ef3" returned: 0 in 0.586s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:14 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-b6d03f60-0030-4577-9497-c0237c4089c3 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-quobyte-68f2b6c7-2455-4fac-983e-dd7c78e79ef3" released by "delete_volume" :: held 1.349s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:14 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-b6d03f60-0030-4577-9497-c0237c4089c3 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Created reservations ['8c7ecd4f-71ac-4d3e-ad36-e7c01990b998', 'b5eedf14-7f56-4954-9b61-bc2f8da0b262', 'c9598397-bb27-4bb5-943d-c8e607775d79', '4060998d-6a2c-4b34-ae33-75c9689c04bb'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:50:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-b6d03f60-0030-4577-9497-c0237c4089c3 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-b6d03f60-0030-4577-9497-c0237c4089c3 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:14 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-b6d03f60-0030-4577-9497-c0237c4089c3 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:14 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-b6d03f60-0030-4577-9497-c0237c4089c3 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-b6d03f60-0030-4577-9497-c0237c4089c3 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b6d03f60-0030-4577-9497-c0237c4089c3 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:14 devstack sudo[93664]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-822311c7-01ac-4f0a-b24f-f4118142373f tempest-SnapshotDependencyTests-1048922672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.info" returned: 0 in 0.609s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:14 devstack sudo[93668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:50:14 devstack sudo[93668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:14 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-822311c7-01ac-4f0a-b24f-f4118142373f tempest-SnapshotDependencyTests-1048922672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.219s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.647s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:15 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1009218838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c79301df-4664-4082-ab8b-d2458959853e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd1f691a145456db8e139d2c27a22b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:50:09Z,use_quota=True,user_id='db7ed9321fca423e89016a187ead5008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:50:15 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Creating volume c79301df-4664-4082-ab8b-d2458959853e {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:50:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:15 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:15 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:15 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:50:15 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:50:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c79301df-4664-4082-ab8b-d2458959853e 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:15 devstack sudo[93670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c79301df-4664-4082-ab8b-d2458959853e 1073741824 Apr 29 06:50:15 devstack sudo[93670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:15 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-822311c7-01ac-4f0a-b24f-f4118142373f tempest-SnapshotDependencyTests-1048922672 None] Create snapshot completed successfully Apr 29 06:50:15 devstack sudo[93668]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-b6d03f60-0030-4577-9497-c0237c4089c3 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.625s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:15 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-b6d03f60-0030-4577-9497-c0237c4089c3 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:50:15 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-b6d03f60-0030-4577-9497-c0237c4089c3 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Deleted volume successfully. Apr 29 06:50:15 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-b6d03f60-0030-4577-9497-c0237c4089c3 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-68f2b6c7-2455-4fac-983e-dd7c78e79ef3-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:15 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9fd65ed5-4865-4120-b100-6ef717517e8e tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "cinder-17ecb8e3-6f97-4e67-9dcf-c05ac6f937e8-delete_snapshot" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:15 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9fd65ed5-4865-4120-b100-6ef717517e8e tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-17ecb8e3-6f97-4e67-9dcf-c05ac6f937e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:15 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9fd65ed5-4865-4120-b100-6ef717517e8e tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "cinder-quobyte-5c133b96-63bd-42c2-8d2f-880a7121d974" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:15 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9fd65ed5-4865-4120-b100-6ef717517e8e tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-quobyte-5c133b96-63bd-42c2-8d2f-880a7121d974" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:15 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9fd65ed5-4865-4120-b100-6ef717517e8e tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "cinder-quobyte-17ecb8e3-6f97-4e67-9dcf-c05ac6f937e8" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:15 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9fd65ed5-4865-4120-b100-6ef717517e8e tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-quobyte-17ecb8e3-6f97-4e67-9dcf-c05ac6f937e8" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:15 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-9fd65ed5-4865-4120-b100-6ef717517e8e tempest-CreateVolumesFromSnapshotTest-1486202130 None] Deleting offline snapshot 17ecb8e3-6f97-4e67-9dcf-c05ac6f937e8 of volume 5c133b96-63bd-42c2-8d2f-880a7121d974 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:50:15 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-9fd65ed5-4865-4120-b100-6ef717517e8e tempest-CreateVolumesFromSnapshotTest-1486202130 None] snapshot_file for this snap is: volume-5c133b96-63bd-42c2-8d2f-880a7121d974.17ecb8e3-6f97-4e67-9dcf-c05ac6f937e8 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:50:15 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[925b03fc-dcaf-43ae-bbff-25aab7524e75]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9fd65ed5-4865-4120-b100-6ef717517e8e tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974.17ecb8e3-6f97-4e67-9dcf-c05ac6f937e8 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:15 devstack sudo[93676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974.17ecb8e3-6f97-4e67-9dcf-c05ac6f937e8 Apr 29 06:50:15 devstack sudo[93676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:15 devstack sudo[93670]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c79301df-4664-4082-ab8b-d2458959853e 1073741824" returned: 0 in 0.861s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:15 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c79301df-4664-4082-ab8b-d2458959853e {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:15 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c79301df-4664-4082-ab8b-d2458959853e Apr 29 06:50:15 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Flow 'volume_create_manager' (5cfa5e2f-dea5-4e95-8e9d-c7febe6f1284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb6a4b2-e4ba-4e68-bcbc-dab50a220abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb6a4b2-e4ba-4e68-bcbc-dab50a220abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41b75d2f-e1cf-4099-a632-7df548895afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d249a88184f4b94a41c862a9a3d838f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3ae16046-ce72-47d3-a8eb-a229a7d29c46,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:50:16Z,use_quota=True,user_id='3a10b2896b124a3dbb43c7705bb0fac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abaf60d0-6971-4ad6-a158-c9b6cc113921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abaf60d0-6971-4ad6-a158-c9b6cc113921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c118656-0cfd-45f4-8242-ceecc332bc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c118656-0cfd-45f4-8242-ceecc332bc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '41b75d2f-e1cf-4099-a632-7df548895afa', 'volume_name': 'volume-41b75d2f-e1cf-4099-a632-7df548895afa', 'volume_size': 1, 'snapshot_id': '3ae16046-ce72-47d3-a8eb-a229a7d29c46'}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fefd73cd-cbf3-43c9-9518-eb93969caaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fefd73cd-cbf3-43c9-9518-eb93969caaf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (084d5335-f0f9-4e78-b8e1-6b3a3f207a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:16 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Volume 41b75d2f-e1cf-4099-a632-7df548895afa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-41b75d2f-e1cf-4099-a632-7df548895afa', 'volume_size': 1, 'snapshot_id': '3ae16046-ce72-47d3-a8eb-a229a7d29c46'} Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:16 devstack sudo[93676]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9fd65ed5-4865-4120-b100-6ef717517e8e tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974.17ecb8e3-6f97-4e67-9dcf-c05ac6f937e8" returned: 0 in 0.799s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-9fd65ed5-4865-4120-b100-6ef717517e8e tempest-CreateVolumesFromSnapshotTest-1486202130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c133b96-63bd-42c2-8d2f-880a7121d974(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42765f3-952f-4787-a581-bfa31dfb3d8e]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9fd65ed5-4865-4120-b100-6ef717517e8e tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:16 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c79301df-4664-4082-ab8b-d2458959853e" returned: 0 in 0.659s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.890s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2000607083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed06d585-3f17-4175-b3d2-e2145c6cdceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd1f691a145456db8e139d2c27a22b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:50:10Z,use_quota=True,user_id='db7ed9321fca423e89016a187ead5008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Creating volume ed06d585-3f17-4175-b3d2-e2145c6cdceb {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:50:16 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ed06d585-3f17-4175-b3d2-e2145c6cdceb 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:16 devstack sudo[93685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ed06d585-3f17-4175-b3d2-e2145c6cdceb 1073741824 Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c6bdcb4-70ab-47f6-8a91-4e51d060e6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c79301df-4664-4082-ab8b-d2458959853e', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:16 devstack sudo[93685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4a0bc1-f5f4-44cb-bfcd-33cc387532cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:16 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Volume volume-c79301df-4664-4082-ab8b-d2458959853e (c79301df-4664-4082-ab8b-d2458959853e): created successfully Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4a0bc1-f5f4-44cb-bfcd-33cc387532cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:16 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Flow 'volume_create_manager' (57f6c074-2cdc-4e9b-8c0d-aa7f4208d22f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:50:16 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-08486b2f-7efc-40d5-abab-dc05e89104b4 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Created volume successfully. Apr 29 06:50:16 devstack sudo[93684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974 Apr 29 06:50:16 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:17 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9fd65ed5-4865-4120-b100-6ef717517e8e tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974" returned: 0 in 0.755s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9fd65ed5-4865-4120-b100-6ef717517e8e tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974.17ecb8e3-6f97-4e67-9dcf-c05ac6f937e8 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:17 devstack sudo[93696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974.17ecb8e3-6f97-4e67-9dcf-c05ac6f937e8 Apr 29 06:50:17 devstack sudo[93696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:17 devstack sudo[93685]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ed06d585-3f17-4175-b3d2-e2145c6cdceb 1073741824" returned: 0 in 0.774s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:17 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ed06d585-3f17-4175-b3d2-e2145c6cdceb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:17 devstack sudo[93698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ed06d585-3f17-4175-b3d2-e2145c6cdceb Apr 29 06:50:17 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:18 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ed06d585-3f17-4175-b3d2-e2145c6cdceb" returned: 0 in 0.624s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:50:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:18 devstack sudo[93696]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-41035465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80cc0294-be65-499c-8cc5-690f5161e997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd1f691a145456db8e139d2c27a22b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:50:10Z,use_quota=True,user_id='db7ed9321fca423e89016a187ead5008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:50:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Creating volume 80cc0294-be65-499c-8cc5-690f5161e997 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:50:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:18 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:50:18 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:50:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-80cc0294-be65-499c-8cc5-690f5161e997 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9fd65ed5-4865-4120-b100-6ef717517e8e tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974.17ecb8e3-6f97-4e67-9dcf-c05ac6f937e8" returned: 0 in 0.747s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9fd65ed5-4865-4120-b100-6ef717517e8e tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974.17ecb8e3-6f97-4e67-9dcf-c05ac6f937e8 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:18 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-80cc0294-be65-499c-8cc5-690f5161e997 1073741824 Apr 29 06:50:18 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749e3a34-6728-4002-b511-ad800c85be0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed06d585-3f17-4175-b3d2-e2145c6cdceb', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ecfa1a-0b02-4bee-9577-a6aa1026ddfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:18 devstack sudo[93706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974.17ecb8e3-6f97-4e67-9dcf-c05ac6f937e8 Apr 29 06:50:18 devstack sudo[93706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:18 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Volume volume-ed06d585-3f17-4175-b3d2-e2145c6cdceb (ed06d585-3f17-4175-b3d2-e2145c6cdceb): created successfully Apr 29 06:50:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ecfa1a-0b02-4bee-9577-a6aa1026ddfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:18 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Flow 'volume_create_manager' (979c1406-c61e-4f52-8d93-9216350830bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:50:18 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-9c158f4e-e7ba-4e3e-b9d1-2c1bfaa0f150 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Created volume successfully. Apr 29 06:50:18 devstack sudo[93706]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9fd65ed5-4865-4120-b100-6ef717517e8e tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974.17ecb8e3-6f97-4e67-9dcf-c05ac6f937e8" returned: 0 in 0.643s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:18 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9fd65ed5-4865-4120-b100-6ef717517e8e tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-quobyte-17ecb8e3-6f97-4e67-9dcf-c05ac6f937e8" released by "_delete_snapshot" :: held 3.048s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:18 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9fd65ed5-4865-4120-b100-6ef717517e8e tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-quobyte-5c133b96-63bd-42c2-8d2f-880a7121d974" released by "delete_snapshot" :: held 3.081s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:18 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-9fd65ed5-4865-4120-b100-6ef717517e8e tempest-CreateVolumesFromSnapshotTest-1486202130 None] Created reservations ['6b2880ab-83ab-435d-8c06-b51b03412695', 'cd53b39f-adbf-4849-afb1-ec2702a8c497', 'caa92e41-8283-4aa2-8b4e-b777e4e62123', '13cd3ca6-3991-4d55-b021-f2f264796eae'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:50:18 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-80cc0294-be65-499c-8cc5-690f5161e997 1073741824" returned: 0 in 0.782s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:18 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-80cc0294-be65-499c-8cc5-690f5161e997 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:18 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-9fd65ed5-4865-4120-b100-6ef717517e8e tempest-CreateVolumesFromSnapshotTest-1486202130 None] Delete snapshot completed successfully. Apr 29 06:50:18 devstack sudo[93713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-80cc0294-be65-499c-8cc5-690f5161e997 Apr 29 06:50:18 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9fd65ed5-4865-4120-b100-6ef717517e8e tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-17ecb8e3-6f97-4e67-9dcf-c05ac6f937e8-delete_snapshot" released by "delete_snapshot" :: held 3.246s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:18 devstack sudo[93713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:19 devstack sudo[93713]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-80cc0294-be65-499c-8cc5-690f5161e997" returned: 0 in 0.614s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:19 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:50:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:19 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-992151184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5707946c-8576-46b2-88dd-de64c11a305a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd1f691a145456db8e139d2c27a22b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:50:10Z,use_quota=True,user_id='db7ed9321fca423e89016a187ead5008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:50:19 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Creating volume 5707946c-8576-46b2-88dd-de64c11a305a {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:50:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:19 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:19 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:19 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:50:19 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:50:19 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5707946c-8576-46b2-88dd-de64c11a305a 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:19 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc2eea44-47fe-454b-bdf6-ef1f07093149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80cc0294-be65-499c-8cc5-690f5161e997', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:19 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b887bf2-75f7-4cb4-80a7-0cbebb3b3215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:19 devstack sudo[93716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5707946c-8576-46b2-88dd-de64c11a305a 1073741824 Apr 29 06:50:19 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:19 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Volume volume-80cc0294-be65-499c-8cc5-690f5161e997 (80cc0294-be65-499c-8cc5-690f5161e997): created successfully Apr 29 06:50:19 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b887bf2-75f7-4cb4-80a7-0cbebb3b3215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:19 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Flow 'volume_create_manager' (048a1e13-2355-49c1-bc0f-802d7d4dc52b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:50:19 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-5d6f5742-6c26-4ba4-a6a2-0d77fa35effc tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Created volume successfully. Apr 29 06:50:19 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-e973f001-a7ff-446b-96f2-8eefd6deecc0 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "cinder-5c133b96-63bd-42c2-8d2f-880a7121d974-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:19 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-e973f001-a7ff-446b-96f2-8eefd6deecc0 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-5c133b96-63bd-42c2-8d2f-880a7121d974-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:19 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-e973f001-a7ff-446b-96f2-8eefd6deecc0 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "cinder-quobyte-5c133b96-63bd-42c2-8d2f-880a7121d974" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:19 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-e973f001-a7ff-446b-96f2-8eefd6deecc0 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-quobyte-5c133b96-63bd-42c2-8d2f-880a7121d974" acquired by "delete_volume" :: waited 0.014s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:20 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c82dfc-a414-4e78-a4d0-16c3ceee40e0]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e973f001-a7ff-446b-96f2-8eefd6deecc0 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:20 devstack sudo[93720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974 Apr 29 06:50:20 devstack sudo[93720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:20 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5707946c-8576-46b2-88dd-de64c11a305a 1073741824" returned: 0 in 0.827s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5707946c-8576-46b2-88dd-de64c11a305a {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:20 devstack sudo[93723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5707946c-8576-46b2-88dd-de64c11a305a Apr 29 06:50:20 devstack sudo[93723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:20 devstack sudo[93720]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e973f001-a7ff-446b-96f2-8eefd6deecc0 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974" returned: 0 in 0.713s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e973f001-a7ff-446b-96f2-8eefd6deecc0 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:20 devstack sudo[93728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974 Apr 29 06:50:20 devstack sudo[93728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:20 devstack sudo[93723]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5707946c-8576-46b2-88dd-de64c11a305a" returned: 0 in 0.608s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:20 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:50:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:20 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 10.105s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:20 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Cloning volume af062e96-d99b-4d11-bdcf-9496d14eb893 to volume dba58833-4e73-483e-a2dc-1772f964284c Apr 29 06:50:20 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8753082-586a-4777-a046-03a1833a6a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5707946c-8576-46b2-88dd-de64c11a305a', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca88af5-6225-4102-a488-081879a4c056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:21 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Volume volume-5707946c-8576-46b2-88dd-de64c11a305a (5707946c-8576-46b2-88dd-de64c11a305a): created successfully Apr 29 06:50:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca88af5-6225-4102-a488-081879a4c056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:21 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Flow 'volume_create_manager' (e2070b6a-7871-4286-be07-d1d31a42aa0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:50:21 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-13548a41-4e46-4b84-a521-531904d41b04 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Created volume successfully. Apr 29 06:50:21 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Creating offline snapshot fbb9e731-088b-4e40-bfde-3f895af05903 of volume af062e96-d99b-4d11-bdcf-9496d14eb893 {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:50:21 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa61ab1-4ab5-4657-9ffd-ea629e2b9472]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:21 devstack sudo[93731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893 Apr 29 06:50:21 devstack sudo[93731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-57ad9dcf-e7d4-41eb-9cec-e4a686d49df5 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "cinder-5707946c-8576-46b2-88dd-de64c11a305a-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-57ad9dcf-e7d4-41eb-9cec-e4a686d49df5 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "cinder-5707946c-8576-46b2-88dd-de64c11a305a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:21 devstack sudo[93728]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e973f001-a7ff-446b-96f2-8eefd6deecc0 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5c133b96-63bd-42c2-8d2f-880a7121d974" returned: 0 in 0.663s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-57ad9dcf-e7d4-41eb-9cec-e4a686d49df5 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "cinder-quobyte-5707946c-8576-46b2-88dd-de64c11a305a" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-e973f001-a7ff-446b-96f2-8eefd6deecc0 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-quobyte-5c133b96-63bd-42c2-8d2f-880a7121d974" released by "delete_volume" :: held 1.433s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:21 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-57ad9dcf-e7d4-41eb-9cec-e4a686d49df5 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "cinder-quobyte-5707946c-8576-46b2-88dd-de64c11a305a" acquired by "delete_volume" :: waited 0.016s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:21 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2f093f-6d55-4d9d-abc6-13a44059efaa]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-57ad9dcf-e7d4-41eb-9cec-e4a686d49df5 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5707946c-8576-46b2-88dd-de64c11a305a {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:21 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-e973f001-a7ff-446b-96f2-8eefd6deecc0 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Created reservations ['7550cef2-9bda-42f9-8ca4-bfb1e82c97a1', '06c6258f-9297-446b-a9c4-5a8823786db0', '0293ce63-50c1-4152-83de-cf0531fd912a', '5690912a-9040-4d13-ae9c-88999c868ca7'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:50:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e973f001-a7ff-446b-96f2-8eefd6deecc0 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e973f001-a7ff-446b-96f2-8eefd6deecc0 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:21 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e973f001-a7ff-446b-96f2-8eefd6deecc0 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:21 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e973f001-a7ff-446b-96f2-8eefd6deecc0 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e973f001-a7ff-446b-96f2-8eefd6deecc0 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e973f001-a7ff-446b-96f2-8eefd6deecc0 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:21 devstack sudo[93734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5707946c-8576-46b2-88dd-de64c11a305a Apr 29 06:50:21 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:21 devstack sudo[93735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:50:21 devstack sudo[93735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:21 devstack sudo[93731]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893" returned: 0 in 0.735s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:21 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.fbb9e731-088b-4e40-bfde-3f895af05903 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:21 devstack sudo[93741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.fbb9e731-088b-4e40-bfde-3f895af05903 1G Apr 29 06:50:21 devstack sudo[93741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:22 devstack sudo[93735]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e973f001-a7ff-446b-96f2-8eefd6deecc0 tempest-CreateVolumesFromSnapshotTest-1486202130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.637s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:22 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-e973f001-a7ff-446b-96f2-8eefd6deecc0 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:50:22 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-e973f001-a7ff-446b-96f2-8eefd6deecc0 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Deleted volume successfully. Apr 29 06:50:22 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:22 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-e973f001-a7ff-446b-96f2-8eefd6deecc0 tempest-CreateVolumesFromSnapshotTest-1486202130 None] Lock "cinder-5c133b96-63bd-42c2-8d2f-880a7121d974-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-57ad9dcf-e7d4-41eb-9cec-e4a686d49df5 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5707946c-8576-46b2-88dd-de64c11a305a" returned: 0 in 0.787s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-57ad9dcf-e7d4-41eb-9cec-e4a686d49df5 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5707946c-8576-46b2-88dd-de64c11a305a {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:22 devstack sudo[93748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5707946c-8576-46b2-88dd-de64c11a305a Apr 29 06:50:22 devstack sudo[93748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:22 devstack sudo[93741]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.fbb9e731-088b-4e40-bfde-3f895af05903 1G" returned: 0 in 0.841s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af062e96-d99b-4d11-bdcf-9496d14eb893 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.fbb9e731-088b-4e40-bfde-3f895af05903 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:22 devstack sudo[93754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af062e96-d99b-4d11-bdcf-9496d14eb893 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.fbb9e731-088b-4e40-bfde-3f895af05903 Apr 29 06:50:22 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:22 devstack sudo[93748]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:22 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-57ad9dcf-e7d4-41eb-9cec-e4a686d49df5 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-5707946c-8576-46b2-88dd-de64c11a305a" returned: 0 in 0.696s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:22 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-57ad9dcf-e7d4-41eb-9cec-e4a686d49df5 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "cinder-quobyte-5707946c-8576-46b2-88dd-de64c11a305a" released by "delete_volume" :: held 1.529s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:23 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-57ad9dcf-e7d4-41eb-9cec-e4a686d49df5 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Created reservations ['6a7fcfb8-d62a-4672-9034-ea15d54325e5', '32a5cc1b-8ee6-4d30-bce6-bc733102846f', 'b065b1c5-d12a-438c-949e-cfbbfa2eeccf', '7ce35c5d-38f2-4a6a-9f10-4db1601b94be'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:50:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-57ad9dcf-e7d4-41eb-9cec-e4a686d49df5 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-57ad9dcf-e7d4-41eb-9cec-e4a686d49df5 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:23 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-57ad9dcf-e7d4-41eb-9cec-e4a686d49df5 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:23 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-57ad9dcf-e7d4-41eb-9cec-e4a686d49df5 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-57ad9dcf-e7d4-41eb-9cec-e4a686d49df5 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-57ad9dcf-e7d4-41eb-9cec-e4a686d49df5 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:23 devstack sudo[93757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:50:23 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:23 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af062e96-d99b-4d11-bdcf-9496d14eb893 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.fbb9e731-088b-4e40-bfde-3f895af05903" returned: 0 in 0.794s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:23 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.fbb9e731-088b-4e40-bfde-3f895af05903 is being set with open permissions: ugo+rw Apr 29 06:50:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.fbb9e731-088b-4e40-bfde-3f895af05903 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:23 devstack sudo[93764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.fbb9e731-088b-4e40-bfde-3f895af05903 Apr 29 06:50:23 devstack sudo[93764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:23 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2c9ae1ba-4310-4306-a83d-3b9b839f5a39 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "cinder-80cc0294-be65-499c-8cc5-690f5161e997-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:23 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2c9ae1ba-4310-4306-a83d-3b9b839f5a39 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "cinder-80cc0294-be65-499c-8cc5-690f5161e997-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:23 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2c9ae1ba-4310-4306-a83d-3b9b839f5a39 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "cinder-quobyte-80cc0294-be65-499c-8cc5-690f5161e997" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:23 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2c9ae1ba-4310-4306-a83d-3b9b839f5a39 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "cinder-quobyte-80cc0294-be65-499c-8cc5-690f5161e997" acquired by "delete_volume" :: waited 0.017s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:23 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d31396-3c9b-450e-92ca-f456dbff9aa6]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2c9ae1ba-4310-4306-a83d-3b9b839f5a39 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-80cc0294-be65-499c-8cc5-690f5161e997 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:23 devstack sudo[93766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-80cc0294-be65-499c-8cc5-690f5161e997 Apr 29 06:50:23 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:23 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:23 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-57ad9dcf-e7d4-41eb-9cec-e4a686d49df5 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.836s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:23 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-57ad9dcf-e7d4-41eb-9cec-e4a686d49df5 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:50:23 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-57ad9dcf-e7d4-41eb-9cec-e4a686d49df5 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Deleted volume successfully. Apr 29 06:50:24 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-57ad9dcf-e7d4-41eb-9cec-e4a686d49df5 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "cinder-5707946c-8576-46b2-88dd-de64c11a305a-delete_volume" released by "delete_volume" :: held 2.716s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:24 devstack sudo[93764]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.fbb9e731-088b-4e40-bfde-3f895af05903" returned: 0 in 0.862s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:24 devstack sudo[93771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.info Apr 29 06:50:24 devstack sudo[93771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:24 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2c9ae1ba-4310-4306-a83d-3b9b839f5a39 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-80cc0294-be65-499c-8cc5-690f5161e997" returned: 0 in 0.888s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:24 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2c9ae1ba-4310-4306-a83d-3b9b839f5a39 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-80cc0294-be65-499c-8cc5-690f5161e997 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:24 devstack sudo[93776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-80cc0294-be65-499c-8cc5-690f5161e997 Apr 29 06:50:24 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:25 devstack sudo[93771]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.info" returned: 0 in 0.686s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:25 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.info is being set with open permissions: ugo+rw Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:25 devstack sudo[93779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.info Apr 29 06:50:25 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:25 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2c9ae1ba-4310-4306-a83d-3b9b839f5a39 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-80cc0294-be65-499c-8cc5-690f5161e997" returned: 0 in 0.656s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2c9ae1ba-4310-4306-a83d-3b9b839f5a39 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "cinder-quobyte-80cc0294-be65-499c-8cc5-690f5161e997" released by "delete_volume" :: held 1.600s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Flow 'volume_create_manager' (3307b26b-de73-426a-b895-bf9b7e77f29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9b01dc0-e30f-44ab-bae6-4bb62cbb96cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9b01dc0-e30f-44ab-bae6-4bb62cbb96cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a9cb54-33d1-4a64-b792-837217eb267c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a518bdae6374462a09e1400cdf52d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:50:25Z,use_quota=True,user_id='a3de4fe309174636a13c1fb4027d3983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db35757-4d41-445c-87fe-9775d286b887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db35757-4d41-445c-87fe-9775d286b887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c5e8ad-ba9a-4cc8-9c6d-a1522a0606bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c5e8ad-ba9a-4cc8-9c6d-a1522a0606bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53a9cb54-33d1-4a64-b792-837217eb267c', 'volume_name': 'volume-53a9cb54-33d1-4a64-b792-837217eb267c', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a148df-22a4-4303-a197-191b399f0f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a148df-22a4-4303-a197-191b399f0f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26acbdb6-1e9d-42ed-bd3e-028745d2fc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:25 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Volume 53a9cb54-33d1-4a64-b792-837217eb267c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53a9cb54-33d1-4a64-b792-837217eb267c', 'volume_size': 1} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-2c9ae1ba-4310-4306-a83d-3b9b839f5a39 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Created reservations ['dd864eea-c2c8-457f-96a0-981e6b261b99', '8979011d-ad17-4ff9-bf69-b43f84250ebe', '51f87185-2a88-463c-9b7e-34c12a75c72b', 'f4c5fc4b-d1cb-4b37-814b-2e3835f57dad'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2c9ae1ba-4310-4306-a83d-3b9b839f5a39 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2c9ae1ba-4310-4306-a83d-3b9b839f5a39 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2c9ae1ba-4310-4306-a83d-3b9b839f5a39 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-2c9ae1ba-4310-4306-a83d-3b9b839f5a39 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-2c9ae1ba-4310-4306-a83d-3b9b839f5a39 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2c9ae1ba-4310-4306-a83d-3b9b839f5a39 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:25 devstack sudo[93783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:50:25 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:25 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.info" returned: 0 in 0.630s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Acquiring lock "cinder-quobyte-dba58833-4e73-483e-a2dc-1772f964284c" by "_copy_volume_from_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Lock "cinder-quobyte-dba58833-4e73-483e-a2dc-1772f964284c" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] snapshot: fbb9e731-088b-4e40-bfde-3f895af05903, volume: dba58833-4e73-483e-a2dc-1772f964284c, {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec022b3a-2b72-4d22-a31a-031196be396d]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.fbb9e731-088b-4e40-bfde-3f895af05903 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:25 devstack sudo[93785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.fbb9e731-088b-4e40-bfde-3f895af05903 Apr 29 06:50:25 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-e335eb46-3e3a-4760-93f9-9c5ced48c018 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "cinder-ed06d585-3f17-4175-b3d2-e2145c6cdceb-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:25 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-e335eb46-3e3a-4760-93f9-9c5ced48c018 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "cinder-ed06d585-3f17-4175-b3d2-e2145c6cdceb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:26 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-e335eb46-3e3a-4760-93f9-9c5ced48c018 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "cinder-quobyte-ed06d585-3f17-4175-b3d2-e2145c6cdceb" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:26 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-e335eb46-3e3a-4760-93f9-9c5ced48c018 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "cinder-quobyte-ed06d585-3f17-4175-b3d2-e2145c6cdceb" acquired by "delete_volume" :: waited 0.015s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:26 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae2bf7a-e64b-4202-b555-1a4060b1f60b]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e335eb46-3e3a-4760-93f9-9c5ced48c018 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ed06d585-3f17-4175-b3d2-e2145c6cdceb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:26 devstack sudo[93787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ed06d585-3f17-4175-b3d2-e2145c6cdceb Apr 29 06:50:26 devstack sudo[93787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:26 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-2c9ae1ba-4310-4306-a83d-3b9b839f5a39 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.697s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:26 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-2c9ae1ba-4310-4306-a83d-3b9b839f5a39 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:50:26 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-2c9ae1ba-4310-4306-a83d-3b9b839f5a39 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Deleted volume successfully. Apr 29 06:50:26 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-2c9ae1ba-4310-4306-a83d-3b9b839f5a39 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "cinder-80cc0294-be65-499c-8cc5-690f5161e997-delete_volume" released by "delete_volume" :: held 2.647s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:26 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.fbb9e731-088b-4e40-bfde-3f895af05903" returned: 0 in 0.766s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:26 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af062e96-d99b-4d11-bdcf-9496d14eb893(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:50:26 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893 {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 06:50:26 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Creating direct copy from snapshot {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 06:50:26 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[3114be6f-1de7-46c4-a6fa-e1d7b2b946a0]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:26 devstack sudo[93793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893 Apr 29 06:50:26 devstack sudo[93793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:26 devstack sudo[93787]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e335eb46-3e3a-4760-93f9-9c5ced48c018 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ed06d585-3f17-4175-b3d2-e2145c6cdceb" returned: 0 in 0.790s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:26 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e335eb46-3e3a-4760-93f9-9c5ced48c018 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ed06d585-3f17-4175-b3d2-e2145c6cdceb {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:26 devstack sudo[93799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ed06d585-3f17-4175-b3d2-e2145c6cdceb Apr 29 06:50:26 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:27 devstack sudo[93793]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893" returned: 0 in 0.730s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:27 devstack cinder-volume[84195]: DEBUG cinder.utils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Path /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-dba58833-4e73-483e-a2dc-1772f964284c not found in is_blk_device check {{(pid=84195) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 06:50:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-dba58833-4e73-483e-a2dc-1772f964284c {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:27 devstack sudo[93804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-dba58833-4e73-483e-a2dc-1772f964284c Apr 29 06:50:27 devstack sudo[93804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:27 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e335eb46-3e3a-4760-93f9-9c5ced48c018 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-ed06d585-3f17-4175-b3d2-e2145c6cdceb" returned: 0 in 0.654s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:27 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-e335eb46-3e3a-4760-93f9-9c5ced48c018 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "cinder-quobyte-ed06d585-3f17-4175-b3d2-e2145c6cdceb" released by "delete_volume" :: held 1.493s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:27 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-e335eb46-3e3a-4760-93f9-9c5ced48c018 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Created reservations ['7fbc5917-7d8a-4f69-87de-e2d36d7ef39f', '428dd3dd-c8d6-4bd2-8df5-068f71e26969', '2c36a304-64da-4796-bf37-e69cb16c4acb', 'a6914082-3b4b-48f8-a544-23fd3a7526a2'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:50:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e335eb46-3e3a-4760-93f9-9c5ced48c018 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e335eb46-3e3a-4760-93f9-9c5ced48c018 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:27 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e335eb46-3e3a-4760-93f9-9c5ced48c018 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:27 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e335eb46-3e3a-4760-93f9-9c5ced48c018 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e335eb46-3e3a-4760-93f9-9c5ced48c018 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:27 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e335eb46-3e3a-4760-93f9-9c5ced48c018 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:27 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:50:27 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:28 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7778bfbc-f9d2-4167-b7a4-6828159766ad tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "cinder-c79301df-4664-4082-ab8b-d2458959853e-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:28 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7778bfbc-f9d2-4167-b7a4-6828159766ad tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "cinder-c79301df-4664-4082-ab8b-d2458959853e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:28 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7778bfbc-f9d2-4167-b7a4-6828159766ad tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "cinder-quobyte-c79301df-4664-4082-ab8b-d2458959853e" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:28 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7778bfbc-f9d2-4167-b7a4-6828159766ad tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "cinder-quobyte-c79301df-4664-4082-ab8b-d2458959853e" acquired by "delete_volume" :: waited 0.041s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:28 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:28 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8eeac73-6475-4752-8a01-345d1d5a119a]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7778bfbc-f9d2-4167-b7a4-6828159766ad tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c79301df-4664-4082-ab8b-d2458959853e {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:28 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e335eb46-3e3a-4760-93f9-9c5ced48c018 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.907s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:28 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-e335eb46-3e3a-4760-93f9-9c5ced48c018 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:50:28 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-e335eb46-3e3a-4760-93f9-9c5ced48c018 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Deleted volume successfully. Apr 29 06:50:28 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-e335eb46-3e3a-4760-93f9-9c5ced48c018 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "cinder-ed06d585-3f17-4175-b3d2-e2145c6cdceb-delete_volume" released by "delete_volume" :: held 2.692s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:28 devstack sudo[93856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c79301df-4664-4082-ab8b-d2458959853e Apr 29 06:50:28 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:30 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7778bfbc-f9d2-4167-b7a4-6828159766ad tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c79301df-4664-4082-ab8b-d2458959853e" returned: 0 in 1.546s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:30 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7778bfbc-f9d2-4167-b7a4-6828159766ad tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c79301df-4664-4082-ab8b-d2458959853e {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:30 devstack sudo[93861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c79301df-4664-4082-ab8b-d2458959853e Apr 29 06:50:30 devstack sudo[93861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:31 devstack sudo[93861]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7778bfbc-f9d2-4167-b7a4-6828159766ad tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-c79301df-4664-4082-ab8b-d2458959853e" returned: 0 in 1.123s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:31 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7778bfbc-f9d2-4167-b7a4-6828159766ad tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "cinder-quobyte-c79301df-4664-4082-ab8b-d2458959853e" released by "delete_volume" :: held 2.796s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:31 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-7778bfbc-f9d2-4167-b7a4-6828159766ad tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Created reservations ['6ed25d8e-8cf3-4f1d-b772-a955dbc3060b', 'b5e14e77-60e4-497a-b655-d30f0bab4289', 'd8fbdd53-28fe-45e9-9899-975a01b6f22f', '33d7e973-826a-451c-a63f-1873ad980fbd'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:50:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7778bfbc-f9d2-4167-b7a4-6828159766ad tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7778bfbc-f9d2-4167-b7a4-6828159766ad tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:31 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-7778bfbc-f9d2-4167-b7a4-6828159766ad tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:31 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-7778bfbc-f9d2-4167-b7a4-6828159766ad tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-7778bfbc-f9d2-4167-b7a4-6828159766ad tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:31 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7778bfbc-f9d2-4167-b7a4-6828159766ad tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:31 devstack sudo[93865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:50:31 devstack sudo[93865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:31 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9461efcd-280a-4d75-a22d-44d92c083eec tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "cinder-b875f9d4-87ec-4be3-b275-65829401cfb0-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:31 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9461efcd-280a-4d75-a22d-44d92c083eec tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "cinder-b875f9d4-87ec-4be3-b275-65829401cfb0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:32 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9461efcd-280a-4d75-a22d-44d92c083eec tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "cinder-quobyte-b875f9d4-87ec-4be3-b275-65829401cfb0" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:32 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9461efcd-280a-4d75-a22d-44d92c083eec tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "cinder-quobyte-b875f9d4-87ec-4be3-b275-65829401cfb0" acquired by "delete_volume" :: waited 0.026s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:32 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd81f640-e711-40f9-90c8-966a5edb658e]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9461efcd-280a-4d75-a22d-44d92c083eec tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b875f9d4-87ec-4be3-b275-65829401cfb0 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:32 devstack sudo[93868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b875f9d4-87ec-4be3-b275-65829401cfb0 Apr 29 06:50:32 devstack sudo[93868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:32 devstack sudo[93804]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-dba58833-4e73-483e-a2dc-1772f964284c" returned: 0 in 5.387s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:32 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[056e9a7c-0add-4363-b54e-df5b7b5734f4]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:32 devstack sudo[93865]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:32 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-7778bfbc-f9d2-4167-b7a4-6828159766ad tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 1.292s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:32 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-7778bfbc-f9d2-4167-b7a4-6828159766ad tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:50:32 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-7778bfbc-f9d2-4167-b7a4-6828159766ad tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Deleted volume successfully. Apr 29 06:50:32 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893 Apr 29 06:50:32 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:32 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-7778bfbc-f9d2-4167-b7a4-6828159766ad tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "cinder-c79301df-4664-4082-ab8b-d2458959853e-delete_volume" released by "delete_volume" :: held 4.505s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:33 devstack sudo[93868]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9461efcd-280a-4d75-a22d-44d92c083eec tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b875f9d4-87ec-4be3-b275-65829401cfb0" returned: 0 in 0.994s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9461efcd-280a-4d75-a22d-44d92c083eec tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b875f9d4-87ec-4be3-b275-65829401cfb0 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:33 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b875f9d4-87ec-4be3-b275-65829401cfb0 Apr 29 06:50:33 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:33 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893" returned: 0 in 0.924s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:33 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Image conversion details: src /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893, size 1024.00 MB, duration 5.39 sec, destination /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-dba58833-4e73-483e-a2dc-1772f964284c {{(pid=84195) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 06:50:33 devstack cinder-volume[84195]: INFO cinder.image.image_utils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Converted 1024.00 MB image at 190.06 MB/s Apr 29 06:50:33 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-dba58833-4e73-483e-a2dc-1772f964284c is being set with open permissions: ugo+rw Apr 29 06:50:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-dba58833-4e73-483e-a2dc-1772f964284c {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:33 devstack sudo[93887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-dba58833-4e73-483e-a2dc-1772f964284c Apr 29 06:50:33 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:33 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9461efcd-280a-4d75-a22d-44d92c083eec tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-b875f9d4-87ec-4be3-b275-65829401cfb0" returned: 0 in 0.624s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:33 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9461efcd-280a-4d75-a22d-44d92c083eec tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "cinder-quobyte-b875f9d4-87ec-4be3-b275-65829401cfb0" released by "delete_volume" :: held 1.713s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:33 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-9461efcd-280a-4d75-a22d-44d92c083eec tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Created reservations ['0687794c-3e4c-4c6a-bba5-812020dedf0f', 'a6fd8b94-3ad7-4810-997a-898af864306a', '956649c4-235f-4efa-a5d4-4d2f1ec8bf93', '82e80f75-59cc-4308-8b24-4df726266583'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:50:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9461efcd-280a-4d75-a22d-44d92c083eec tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9461efcd-280a-4d75-a22d-44d92c083eec tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:33 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9461efcd-280a-4d75-a22d-44d92c083eec tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:33 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-9461efcd-280a-4d75-a22d-44d92c083eec tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-9461efcd-280a-4d75-a22d-44d92c083eec tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:33 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9461efcd-280a-4d75-a22d-44d92c083eec tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:33 devstack sudo[93890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:50:33 devstack sudo[93890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:34 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1cac4aec-be11-40f2-a832-34a7920ec5e0 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "cinder-8737439d-cec9-4fa7-a157-8b04b5838532-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:34 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-dba58833-4e73-483e-a2dc-1772f964284c" returned: 0 in 0.651s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:34 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1cac4aec-be11-40f2-a832-34a7920ec5e0 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "cinder-8737439d-cec9-4fa7-a157-8b04b5838532-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:34 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Lock "cinder-quobyte-dba58833-4e73-483e-a2dc-1772f964284c" released by "_copy_volume_from_snapshot" :: held 8.547s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:34 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Acquiring lock "cinder-quobyte-fbb9e731-088b-4e40-bfde-3f895af05903" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:34 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1cac4aec-be11-40f2-a832-34a7920ec5e0 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "cinder-quobyte-8737439d-cec9-4fa7-a157-8b04b5838532" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:34 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Lock "cinder-quobyte-fbb9e731-088b-4e40-bfde-3f895af05903" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Deleting offline snapshot fbb9e731-088b-4e40-bfde-3f895af05903 of volume af062e96-d99b-4d11-bdcf-9496d14eb893 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:50:34 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] snapshot_file for this snap is: volume-af062e96-d99b-4d11-bdcf-9496d14eb893.fbb9e731-088b-4e40-bfde-3f895af05903 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:50:34 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1cac4aec-be11-40f2-a832-34a7920ec5e0 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "cinder-quobyte-8737439d-cec9-4fa7-a157-8b04b5838532" acquired by "delete_volume" :: waited 0.038s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:34 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[2987c9da-de55-4604-9299-7a9c9087ae5b]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.fbb9e731-088b-4e40-bfde-3f895af05903 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:34 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb7ea0f-0982-48f3-bc99-31671407ace1]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1cac4aec-be11-40f2-a832-34a7920ec5e0 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8737439d-cec9-4fa7-a157-8b04b5838532 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:34 devstack sudo[93893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.fbb9e731-088b-4e40-bfde-3f895af05903 Apr 29 06:50:34 devstack sudo[93893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:34 devstack sudo[93894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8737439d-cec9-4fa7-a157-8b04b5838532 Apr 29 06:50:34 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:34 devstack sudo[93890]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:34 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-9461efcd-280a-4d75-a22d-44d92c083eec tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.608s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:34 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-9461efcd-280a-4d75-a22d-44d92c083eec tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:50:34 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-9461efcd-280a-4d75-a22d-44d92c083eec tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Deleted volume successfully. Apr 29 06:50:34 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-9461efcd-280a-4d75-a22d-44d92c083eec tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "cinder-b875f9d4-87ec-4be3-b275-65829401cfb0-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:35 devstack sudo[93893]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.fbb9e731-088b-4e40-bfde-3f895af05903" returned: 0 in 0.745s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af062e96-d99b-4d11-bdcf-9496d14eb893(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:50:35 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69db87b-fd9d-45d6-ae9c-4f44161f0aac]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:35 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1cac4aec-be11-40f2-a832-34a7920ec5e0 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8737439d-cec9-4fa7-a157-8b04b5838532" returned: 0 in 0.774s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1cac4aec-be11-40f2-a832-34a7920ec5e0 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8737439d-cec9-4fa7-a157-8b04b5838532 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:35 devstack sudo[93908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8737439d-cec9-4fa7-a157-8b04b5838532 Apr 29 06:50:35 devstack sudo[93908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:35 devstack sudo[93907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893 Apr 29 06:50:35 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:35 devstack sudo[93908]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1cac4aec-be11-40f2-a832-34a7920ec5e0 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8737439d-cec9-4fa7-a157-8b04b5838532" returned: 0 in 0.629s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:35 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1cac4aec-be11-40f2-a832-34a7920ec5e0 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "cinder-quobyte-8737439d-cec9-4fa7-a157-8b04b5838532" released by "delete_volume" :: held 1.445s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:35 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-1cac4aec-be11-40f2-a832-34a7920ec5e0 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Created reservations ['b20965d3-dee1-4c60-85ae-51ced16ffab2', '2232102a-a225-4af1-920a-d57fad7d3432', 'e1127100-f7f2-4362-8b79-b55bd8957d07', 'ca4b3eb8-eacc-4742-a6b4-1bd42baa3832'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:50:35 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893" returned: 0 in 0.735s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.fbb9e731-088b-4e40-bfde-3f895af05903 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:35 devstack sudo[93915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.fbb9e731-088b-4e40-bfde-3f895af05903 Apr 29 06:50:35 devstack sudo[93915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1cac4aec-be11-40f2-a832-34a7920ec5e0 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1cac4aec-be11-40f2-a832-34a7920ec5e0 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1cac4aec-be11-40f2-a832-34a7920ec5e0 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:35 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1cac4aec-be11-40f2-a832-34a7920ec5e0 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1cac4aec-be11-40f2-a832-34a7920ec5e0 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:35 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1cac4aec-be11-40f2-a832-34a7920ec5e0 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:35 devstack sudo[93917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:50:35 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:36 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1cac4aec-be11-40f2-a832-34a7920ec5e0 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.635s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:36 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-1cac4aec-be11-40f2-a832-34a7920ec5e0 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:50:36 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-1cac4aec-be11-40f2-a832-34a7920ec5e0 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Deleted volume successfully. Apr 29 06:50:36 devstack cinder-volume[84195]: DEBUG oslo_service.periodic_task [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84195) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 06:50:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:36 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:36 devstack sudo[93915]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.fbb9e731-088b-4e40-bfde-3f895af05903" returned: 0 in 0.750s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:36 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.fbb9e731-088b-4e40-bfde-3f895af05903 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:36 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:50:36 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:36 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1cac4aec-be11-40f2-a832-34a7920ec5e0 tempest-CreateVolumesFromSourceVolumeTest-1410188482 None] Lock "cinder-8737439d-cec9-4fa7-a157-8b04b5838532-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:36 devstack sudo[93925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.fbb9e731-088b-4e40-bfde-3f895af05903 Apr 29 06:50:36 devstack sudo[93925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:37 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.666s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-8cdbe329-557f-4fce-8894-37ee9197255e None None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:50:37 devstack sudo[93925]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893.fbb9e731-088b-4e40-bfde-3f895af05903" returned: 0 in 0.669s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Lock "cinder-quobyte-fbb9e731-088b-4e40-bfde-3f895af05903" released by "_delete_snapshot" :: held 3.009s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.387s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 21.122s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Acquiring lock "cinder-quobyte-3ae16046-ce72-47d3-a8eb-a229a7d29c46-41b75d2f-e1cf-4099-a632-7df548895afa" by "_create_volume_from_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a5970aa-ce84-48ee-970b-1cce738249ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dba58833-4e73-483e-a2dc-1772f964284c', 'volume_size': 1, 'source_volid': 'af062e96-d99b-4d11-bdcf-9496d14eb893', 'source_volstatus': 'available'}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6795ceb-0550-4267-b69a-157f19927a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Lock "cinder-quobyte-3ae16046-ce72-47d3-a8eb-a229a7d29c46-41b75d2f-e1cf-4099-a632-7df548895afa" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Creating volume 41b75d2f-e1cf-4099-a632-7df548895afa from snapshot 3ae16046-ce72-47d3-a8eb-a229a7d29c46 {{(pid=84195) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Acquiring lock "cinder-quobyte-41b75d2f-e1cf-4099-a632-7df548895afa" by "_copy_volume_from_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:37 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Volume volume-dba58833-4e73-483e-a2dc-1772f964284c (dba58833-4e73-483e-a2dc-1772f964284c): created successfully Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6795ceb-0550-4267-b69a-157f19927a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Flow 'volume_create_manager' (186451da-8bd0-4d22-8c1c-ff80ff555bb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Lock "cinder-quobyte-41b75d2f-e1cf-4099-a632-7df548895afa" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] snapshot: 3ae16046-ce72-47d3-a8eb-a229a7d29c46, volume: 41b75d2f-e1cf-4099-a632-7df548895afa, {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:37 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-c07a0c3c-ddc7-43ee-a501-452504f956e5 tempest-VolumeDependencyTests-709056386 None] Created volume successfully. Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[78213a62-2cc4-4a0e-ac27-4370648f282a]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.3ae16046-ce72-47d3-a8eb-a229a7d29c46 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:37 devstack sudo[93931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.3ae16046-ce72-47d3-a8eb-a229a7d29c46 Apr 29 06:50:37 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c42e1215-c3f9-47b2-9019-2037092f12ad tempest-VolumeDependencyTests-709056386 None] Acquiring lock "cinder-af062e96-d99b-4d11-bdcf-9496d14eb893-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c42e1215-c3f9-47b2-9019-2037092f12ad tempest-VolumeDependencyTests-709056386 None] Lock "cinder-af062e96-d99b-4d11-bdcf-9496d14eb893-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c42e1215-c3f9-47b2-9019-2037092f12ad tempest-VolumeDependencyTests-709056386 None] Acquiring lock "cinder-quobyte-af062e96-d99b-4d11-bdcf-9496d14eb893" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c42e1215-c3f9-47b2-9019-2037092f12ad tempest-VolumeDependencyTests-709056386 None] Lock "cinder-quobyte-af062e96-d99b-4d11-bdcf-9496d14eb893" acquired by "delete_volume" :: waited 0.019s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0eaef4-5bd6-41a1-82c0-5dc2153c4784]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:37 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c42e1215-c3f9-47b2-9019-2037092f12ad tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:38 devstack sudo[93934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893 Apr 29 06:50:38 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:38 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.3ae16046-ce72-47d3-a8eb-a229a7d29c46" returned: 0 in 0.764s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:38 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6359c89-ba9b-46a2-b605-d9300aaadef7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:50:38 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7 {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 06:50:38 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Creating direct copy from snapshot {{(pid=84195) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 06:50:38 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[3675e7b0-be7f-440f-8f52-2c816c09122e]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:38 devstack sudo[93939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7 Apr 29 06:50:38 devstack sudo[93939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:38 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c42e1215-c3f9-47b2-9019-2037092f12ad tempest-VolumeDependencyTests-709056386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893" returned: 0 in 0.737s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:38 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c42e1215-c3f9-47b2-9019-2037092f12ad tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:38 devstack sudo[93944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893 Apr 29 06:50:38 devstack sudo[93944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:39 devstack sudo[93939]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7" returned: 0 in 0.712s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:39 devstack cinder-volume[84195]: DEBUG cinder.utils [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Path /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-41b75d2f-e1cf-4099-a632-7df548895afa not found in is_blk_device check {{(pid=84195) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 06:50:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-41b75d2f-e1cf-4099-a632-7df548895afa {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:39 devstack sudo[93949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-41b75d2f-e1cf-4099-a632-7df548895afa Apr 29 06:50:39 devstack sudo[93949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:39 devstack sudo[93944]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c42e1215-c3f9-47b2-9019-2037092f12ad tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-af062e96-d99b-4d11-bdcf-9496d14eb893" returned: 0 in 0.608s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:39 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c42e1215-c3f9-47b2-9019-2037092f12ad tempest-VolumeDependencyTests-709056386 None] Lock "cinder-quobyte-af062e96-d99b-4d11-bdcf-9496d14eb893" released by "delete_volume" :: held 1.413s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:39 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-c42e1215-c3f9-47b2-9019-2037092f12ad tempest-VolumeDependencyTests-709056386 None] Created reservations ['bff45301-08ee-47f4-a212-c7fd48bacb2a', '1ee884e8-a786-4680-bfc7-f9b5d181f3e5', '2339e670-64bb-4d59-9774-dfcb354c98f9', '8acadcfe-8fb4-40c7-b670-165e6d3e5655'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:50:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c42e1215-c3f9-47b2-9019-2037092f12ad tempest-VolumeDependencyTests-709056386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c42e1215-c3f9-47b2-9019-2037092f12ad tempest-VolumeDependencyTests-709056386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:39 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c42e1215-c3f9-47b2-9019-2037092f12ad tempest-VolumeDependencyTests-709056386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:39 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c42e1215-c3f9-47b2-9019-2037092f12ad tempest-VolumeDependencyTests-709056386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c42e1215-c3f9-47b2-9019-2037092f12ad tempest-VolumeDependencyTests-709056386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:39 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c42e1215-c3f9-47b2-9019-2037092f12ad tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:39 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:50:39 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:40 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4ea141cb-854c-40d4-b404-4c9208d474d6 tempest-VolumeDependencyTests-709056386 None] Acquiring lock "cinder-dba58833-4e73-483e-a2dc-1772f964284c-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:40 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c42e1215-c3f9-47b2-9019-2037092f12ad tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.795s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:40 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-c42e1215-c3f9-47b2-9019-2037092f12ad tempest-VolumeDependencyTests-709056386 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:50:40 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4ea141cb-854c-40d4-b404-4c9208d474d6 tempest-VolumeDependencyTests-709056386 None] Lock "cinder-dba58833-4e73-483e-a2dc-1772f964284c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:40 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-c42e1215-c3f9-47b2-9019-2037092f12ad tempest-VolumeDependencyTests-709056386 None] Deleted volume successfully. Apr 29 06:50:40 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c42e1215-c3f9-47b2-9019-2037092f12ad tempest-VolumeDependencyTests-709056386 None] Lock "cinder-af062e96-d99b-4d11-bdcf-9496d14eb893-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:40 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4ea141cb-854c-40d4-b404-4c9208d474d6 tempest-VolumeDependencyTests-709056386 None] Acquiring lock "cinder-quobyte-dba58833-4e73-483e-a2dc-1772f964284c" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:40 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4ea141cb-854c-40d4-b404-4c9208d474d6 tempest-VolumeDependencyTests-709056386 None] Lock "cinder-quobyte-dba58833-4e73-483e-a2dc-1772f964284c" acquired by "delete_volume" :: waited 0.035s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:40 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e829d73-e4de-4af3-bc50-2f6d84ab2288]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:40 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4ea141cb-854c-40d4-b404-4c9208d474d6 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-dba58833-4e73-483e-a2dc-1772f964284c {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:40 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-dba58833-4e73-483e-a2dc-1772f964284c Apr 29 06:50:40 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:42 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4ea141cb-854c-40d4-b404-4c9208d474d6 tempest-VolumeDependencyTests-709056386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-dba58833-4e73-483e-a2dc-1772f964284c" returned: 0 in 1.605s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:42 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4ea141cb-854c-40d4-b404-4c9208d474d6 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-dba58833-4e73-483e-a2dc-1772f964284c {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:42 devstack sudo[93971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-dba58833-4e73-483e-a2dc-1772f964284c Apr 29 06:50:42 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:43 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4ea141cb-854c-40d4-b404-4c9208d474d6 tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-dba58833-4e73-483e-a2dc-1772f964284c" returned: 0 in 1.212s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:43 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4ea141cb-854c-40d4-b404-4c9208d474d6 tempest-VolumeDependencyTests-709056386 None] Lock "cinder-quobyte-dba58833-4e73-483e-a2dc-1772f964284c" released by "delete_volume" :: held 2.916s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:43 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-4ea141cb-854c-40d4-b404-4c9208d474d6 tempest-VolumeDependencyTests-709056386 None] Created reservations ['c8faafb6-b633-406d-bf47-288913ade85e', '55f31afc-750e-46ea-9fd3-7872c99d3dcd', '1472c109-d1bf-4bb5-a300-892ce620863a', 'd9c40e9a-acdd-4ec1-bbf8-5878c0f5ca3d'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:50:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4ea141cb-854c-40d4-b404-4c9208d474d6 tempest-VolumeDependencyTests-709056386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4ea141cb-854c-40d4-b404-4c9208d474d6 tempest-VolumeDependencyTests-709056386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:43 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4ea141cb-854c-40d4-b404-4c9208d474d6 tempest-VolumeDependencyTests-709056386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:43 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-4ea141cb-854c-40d4-b404-4c9208d474d6 tempest-VolumeDependencyTests-709056386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-4ea141cb-854c-40d4-b404-4c9208d474d6 tempest-VolumeDependencyTests-709056386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:43 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4ea141cb-854c-40d4-b404-4c9208d474d6 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:43 devstack sudo[93974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:50:43 devstack sudo[93974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:43 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c44eebc0-81db-484b-aa30-872ffcd9e9a5 tempest-VolumeDependencyTests-709056386 None] Acquiring lock "cinder-02c11bcc-b01b-4452-8ccf-2715ce2ffe80-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:43 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c44eebc0-81db-484b-aa30-872ffcd9e9a5 tempest-VolumeDependencyTests-709056386 None] Lock "cinder-02c11bcc-b01b-4452-8ccf-2715ce2ffe80-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:44 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c44eebc0-81db-484b-aa30-872ffcd9e9a5 tempest-VolumeDependencyTests-709056386 None] Acquiring lock "cinder-quobyte-02c11bcc-b01b-4452-8ccf-2715ce2ffe80" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:44 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c44eebc0-81db-484b-aa30-872ffcd9e9a5 tempest-VolumeDependencyTests-709056386 None] Lock "cinder-quobyte-02c11bcc-b01b-4452-8ccf-2715ce2ffe80" acquired by "delete_volume" :: waited 0.039s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:44 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba61b583-3d87-4b04-8a57-2cc409aba450]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c44eebc0-81db-484b-aa30-872ffcd9e9a5 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-02c11bcc-b01b-4452-8ccf-2715ce2ffe80 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:44 devstack sudo[93976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-02c11bcc-b01b-4452-8ccf-2715ce2ffe80 Apr 29 06:50:44 devstack sudo[93976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:44 devstack sudo[93949]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-41b75d2f-e1cf-4099-a632-7df548895afa" returned: 0 in 5.307s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:44 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c9edad-6583-46d5-a572-89822b7476d9]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:44 devstack sudo[93974]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-4ea141cb-854c-40d4-b404-4c9208d474d6 tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.874s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:44 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-4ea141cb-854c-40d4-b404-4c9208d474d6 tempest-VolumeDependencyTests-709056386 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:50:44 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-4ea141cb-854c-40d4-b404-4c9208d474d6 tempest-VolumeDependencyTests-709056386 None] Deleted volume successfully. Apr 29 06:50:44 devstack sudo[93979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7 Apr 29 06:50:44 devstack sudo[93979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:44 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-4ea141cb-854c-40d4-b404-4c9208d474d6 tempest-VolumeDependencyTests-709056386 None] Lock "cinder-dba58833-4e73-483e-a2dc-1772f964284c-delete_volume" released by "delete_volume" :: held 4.217s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:44 devstack sudo[93976]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c44eebc0-81db-484b-aa30-872ffcd9e9a5 tempest-VolumeDependencyTests-709056386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-02c11bcc-b01b-4452-8ccf-2715ce2ffe80" returned: 0 in 0.758s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:44 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c44eebc0-81db-484b-aa30-872ffcd9e9a5 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-02c11bcc-b01b-4452-8ccf-2715ce2ffe80 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:44 devstack sudo[93984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-02c11bcc-b01b-4452-8ccf-2715ce2ffe80 Apr 29 06:50:44 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:45 devstack sudo[93979]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7" returned: 0 in 0.889s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG cinder.image.image_utils [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Image conversion details: src /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7, size 1024.00 MB, duration 5.31 sec, destination /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-41b75d2f-e1cf-4099-a632-7df548895afa {{(pid=84195) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 06:50:45 devstack cinder-volume[84195]: INFO cinder.image.image_utils [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Converted 1024.00 MB image at 192.90 MB/s Apr 29 06:50:45 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-41b75d2f-e1cf-4099-a632-7df548895afa is being set with open permissions: ugo+rw Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-41b75d2f-e1cf-4099-a632-7df548895afa {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:45 devstack sudo[93989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-41b75d2f-e1cf-4099-a632-7df548895afa Apr 29 06:50:45 devstack sudo[93989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:45 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c44eebc0-81db-484b-aa30-872ffcd9e9a5 tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-02c11bcc-b01b-4452-8ccf-2715ce2ffe80" returned: 0 in 0.612s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c44eebc0-81db-484b-aa30-872ffcd9e9a5 tempest-VolumeDependencyTests-709056386 None] Lock "cinder-quobyte-02c11bcc-b01b-4452-8ccf-2715ce2ffe80" released by "delete_volume" :: held 1.452s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-c44eebc0-81db-484b-aa30-872ffcd9e9a5 tempest-VolumeDependencyTests-709056386 None] Created reservations ['e76a9e19-2caf-4071-917d-789f8828e89b', '98824dc3-0acf-42f1-b46a-47bb9fe6ec75', '0134b5a7-b192-4a8f-a309-2de651cd6e2f', '471d4068-0de3-436e-a349-89ddb5ad7ee9'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c44eebc0-81db-484b-aa30-872ffcd9e9a5 tempest-VolumeDependencyTests-709056386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c44eebc0-81db-484b-aa30-872ffcd9e9a5 tempest-VolumeDependencyTests-709056386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c44eebc0-81db-484b-aa30-872ffcd9e9a5 tempest-VolumeDependencyTests-709056386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-c44eebc0-81db-484b-aa30-872ffcd9e9a5 tempest-VolumeDependencyTests-709056386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-c44eebc0-81db-484b-aa30-872ffcd9e9a5 tempest-VolumeDependencyTests-709056386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c44eebc0-81db-484b-aa30-872ffcd9e9a5 tempest-VolumeDependencyTests-709056386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:45 devstack sudo[93992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:50:45 devstack sudo[93992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:45 devstack sudo[93989]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-41b75d2f-e1cf-4099-a632-7df548895afa" returned: 0 in 0.581s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Lock "cinder-quobyte-41b75d2f-e1cf-4099-a632-7df548895afa" released by "_copy_volume_from_snapshot" :: held 8.378s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Lock "cinder-quobyte-3ae16046-ce72-47d3-a8eb-a229a7d29c46-41b75d2f-e1cf-4099-a632-7df548895afa" released by "_create_volume_from_snapshot" :: held 8.426s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.461s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.339s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a9cb54-33d1-4a64-b792-837217eb267c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a518bdae6374462a09e1400cdf52d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:50:25Z,use_quota=True,user_id='a3de4fe309174636a13c1fb4027d3983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Creating volume 53a9cb54-33d1-4a64-b792-837217eb267c {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:50:45 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-53a9cb54-33d1-4a64-b792-837217eb267c 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:45 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-53a9cb54-33d1-4a64-b792-837217eb267c 1073741824 Apr 29 06:50:45 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (084d5335-f0f9-4e78-b8e1-6b3a3f207a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41b75d2f-e1cf-4099-a632-7df548895afa', 'volume_size': 1, 'snapshot_id': '3ae16046-ce72-47d3-a8eb-a229a7d29c46'}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f1b391a-8cc0-40f5-9898-1996b8120981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:45 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Volume volume-41b75d2f-e1cf-4099-a632-7df548895afa (41b75d2f-e1cf-4099-a632-7df548895afa): created successfully Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f1b391a-8cc0-40f5-9898-1996b8120981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:45 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Flow 'volume_create_manager' (5cfa5e2f-dea5-4e95-8e9d-c7febe6f1284) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:50:45 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-1451c637-be4d-4b57-b6b7-9103e45898ad tempest-SnapshotDependencyTests-1048922672 None] Created volume successfully. Apr 29 06:50:46 devstack sudo[93992]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c44eebc0-81db-484b-aa30-872ffcd9e9a5 tempest-VolumeDependencyTests-709056386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.602s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:46 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-c44eebc0-81db-484b-aa30-872ffcd9e9a5 tempest-VolumeDependencyTests-709056386 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:50:46 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-c44eebc0-81db-484b-aa30-872ffcd9e9a5 tempest-VolumeDependencyTests-709056386 None] Deleted volume successfully. Apr 29 06:50:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c44eebc0-81db-484b-aa30-872ffcd9e9a5 tempest-VolumeDependencyTests-709056386 None] Lock "cinder-02c11bcc-b01b-4452-8ccf-2715ce2ffe80-delete_volume" released by "delete_volume" :: held 2.358s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:46 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-53a9cb54-33d1-4a64-b792-837217eb267c 1073741824" returned: 0 in 0.805s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-53a9cb54-33d1-4a64-b792-837217eb267c {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-39f00d02-00aa-4f7c-83c3-a334700a0d1c tempest-SnapshotDependencyTests-1048922672 None] Acquiring lock "cinder-3ae16046-ce72-47d3-a8eb-a229a7d29c46-delete_snapshot" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:46 devstack sudo[94002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-53a9cb54-33d1-4a64-b792-837217eb267c Apr 29 06:50:46 devstack sudo[94002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-39f00d02-00aa-4f7c-83c3-a334700a0d1c tempest-SnapshotDependencyTests-1048922672 None] Lock "cinder-3ae16046-ce72-47d3-a8eb-a229a7d29c46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-39f00d02-00aa-4f7c-83c3-a334700a0d1c tempest-SnapshotDependencyTests-1048922672 None] Acquiring lock "cinder-quobyte-e6359c89-ba9b-46a2-b605-d9300aaadef7" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-39f00d02-00aa-4f7c-83c3-a334700a0d1c tempest-SnapshotDependencyTests-1048922672 None] Lock "cinder-quobyte-e6359c89-ba9b-46a2-b605-d9300aaadef7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-39f00d02-00aa-4f7c-83c3-a334700a0d1c tempest-SnapshotDependencyTests-1048922672 None] Acquiring lock "cinder-quobyte-3ae16046-ce72-47d3-a8eb-a229a7d29c46" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:46 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-39f00d02-00aa-4f7c-83c3-a334700a0d1c tempest-SnapshotDependencyTests-1048922672 None] Lock "cinder-quobyte-3ae16046-ce72-47d3-a8eb-a229a7d29c46" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-39f00d02-00aa-4f7c-83c3-a334700a0d1c tempest-SnapshotDependencyTests-1048922672 None] Deleting offline snapshot 3ae16046-ce72-47d3-a8eb-a229a7d29c46 of volume e6359c89-ba9b-46a2-b605-d9300aaadef7 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:50:46 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-39f00d02-00aa-4f7c-83c3-a334700a0d1c tempest-SnapshotDependencyTests-1048922672 None] snapshot_file for this snap is: volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.3ae16046-ce72-47d3-a8eb-a229a7d29c46 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:50:46 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[62233357-0c57-4bcc-a346-f2d150e764ce]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:46 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-39f00d02-00aa-4f7c-83c3-a334700a0d1c tempest-SnapshotDependencyTests-1048922672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.3ae16046-ce72-47d3-a8eb-a229a7d29c46 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:46 devstack sudo[94006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.3ae16046-ce72-47d3-a8eb-a229a7d29c46 Apr 29 06:50:46 devstack sudo[94006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:47 devstack sudo[94002]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-53a9cb54-33d1-4a64-b792-837217eb267c" returned: 0 in 0.639s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:50:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26acbdb6-1e9d-42ed-bd3e-028745d2fc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53a9cb54-33d1-4a64-b792-837217eb267c', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094c7418-023a-4353-a283-aa81d4fbfcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:47 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Volume volume-53a9cb54-33d1-4a64-b792-837217eb267c (53a9cb54-33d1-4a64-b792-837217eb267c): created successfully Apr 29 06:50:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094c7418-023a-4353-a283-aa81d4fbfcc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:47 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Flow 'volume_create_manager' (3307b26b-de73-426a-b895-bf9b7e77f29a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:50:47 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-e352349e-4a19-489f-abc0-dcb705eb988f tempest-CinderUnicodeTest-1897560203 None] Created volume successfully. Apr 29 06:50:47 devstack sudo[94006]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-39f00d02-00aa-4f7c-83c3-a334700a0d1c tempest-SnapshotDependencyTests-1048922672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.3ae16046-ce72-47d3-a8eb-a229a7d29c46" returned: 0 in 0.809s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:47 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-39f00d02-00aa-4f7c-83c3-a334700a0d1c tempest-SnapshotDependencyTests-1048922672 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6359c89-ba9b-46a2-b605-d9300aaadef7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:50:47 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afd2f41-b528-4e9f-bccc-31e35b0ac531]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:47 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-39f00d02-00aa-4f7c-83c3-a334700a0d1c tempest-SnapshotDependencyTests-1048922672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:47 devstack sudo[94013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7 Apr 29 06:50:47 devstack sudo[94013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:48 devstack sudo[94013]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-39f00d02-00aa-4f7c-83c3-a334700a0d1c tempest-SnapshotDependencyTests-1048922672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7" returned: 0 in 0.735s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:48 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-39f00d02-00aa-4f7c-83c3-a334700a0d1c tempest-SnapshotDependencyTests-1048922672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.3ae16046-ce72-47d3-a8eb-a229a7d29c46 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:48 devstack sudo[94018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.3ae16046-ce72-47d3-a8eb-a229a7d29c46 Apr 29 06:50:48 devstack sudo[94018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:48 devstack cinder-volume[84195]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84195) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 06:50:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Flow 'volume_create_manager' (ce5e897f-a0e9-4353-a76c-8481358df9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:50:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf605763-e75e-4bf8-aadd-70155ede9ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf605763-e75e-4bf8-aadd-70155ede9ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:50:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2032628526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a518bdae6374462a09e1400cdf52d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:50:49Z,use_quota=True,user_id='a3de4fe309174636a13c1fb4027d3983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:48 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003ba781-3fb9-4706-b461-f8d2c0a11098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003ba781-3fb9-4706-b461-f8d2c0a11098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ad57f4-9fb3-49de-ae68-5fd0465b8446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ad57f4-9fb3-49de-ae68-5fd0465b8446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5', 'volume_name': 'volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa9d1726-7269-41ee-890d-e07d54c4f1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa9d1726-7269-41ee-890d-e07d54c4f1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:49 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d56491-14d0-49ca-9bf4-e3dcfc66b24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:49 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Volume 8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5', 'volume_size': 1} Apr 29 06:50:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T04:50:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2032628526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a518bdae6374462a09e1400cdf52d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T04:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T04:50:49Z,use_quota=True,user_id='a3de4fe309174636a13c1fb4027d3983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97b4360-7440-43d9-851f-71cf160e0d2a),volume_type_id=c97b4360-7440-43d9-851f-71cf160e0d2a)}" {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 06:50:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Creating volume 8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5 {{(pid=84195) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 06:50:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:49 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Selected osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 as target Quobyte volume. {{(pid=84195) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 06:50:49 devstack cinder-volume[84195]: INFO cinder.volume.drivers.remotefs [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] casted to osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9 Apr 29 06:50:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5 1073741824 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:49 devstack sudo[94023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5 1073741824 Apr 29 06:50:49 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:49 devstack sudo[94018]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-39f00d02-00aa-4f7c-83c3-a334700a0d1c tempest-SnapshotDependencyTests-1048922672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.3ae16046-ce72-47d3-a8eb-a229a7d29c46" returned: 0 in 0.729s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-39f00d02-00aa-4f7c-83c3-a334700a0d1c tempest-SnapshotDependencyTests-1048922672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.3ae16046-ce72-47d3-a8eb-a229a7d29c46 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:49 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.3ae16046-ce72-47d3-a8eb-a229a7d29c46 Apr 29 06:50:49 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:49 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-39f00d02-00aa-4f7c-83c3-a334700a0d1c tempest-SnapshotDependencyTests-1048922672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7.3ae16046-ce72-47d3-a8eb-a229a7d29c46" returned: 0 in 0.596s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:49 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-39f00d02-00aa-4f7c-83c3-a334700a0d1c tempest-SnapshotDependencyTests-1048922672 None] Lock "cinder-quobyte-3ae16046-ce72-47d3-a8eb-a229a7d29c46" released by "_delete_snapshot" :: held 2.990s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:49 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-39f00d02-00aa-4f7c-83c3-a334700a0d1c tempest-SnapshotDependencyTests-1048922672 None] Lock "cinder-quobyte-e6359c89-ba9b-46a2-b605-d9300aaadef7" released by "delete_snapshot" :: held 3.016s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:49 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5 1073741824" returned: 0 in 0.766s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:49 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:49 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-39f00d02-00aa-4f7c-83c3-a334700a0d1c tempest-SnapshotDependencyTests-1048922672 None] Created reservations ['f54560b2-b018-498a-8c8f-bd141a01605d', 'fe38dae7-5701-4e50-b79b-bf873ff5e185', '2a57f3f8-2554-4746-a6f5-c42085c569ca', '83c8a548-2b4a-48c0-8954-110160ee0696'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:50:49 devstack sudo[94032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5 Apr 29 06:50:49 devstack sudo[94032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:49 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-39f00d02-00aa-4f7c-83c3-a334700a0d1c tempest-SnapshotDependencyTests-1048922672 None] Delete snapshot completed successfully. Apr 29 06:50:49 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-39f00d02-00aa-4f7c-83c3-a334700a0d1c tempest-SnapshotDependencyTests-1048922672 None] Lock "cinder-3ae16046-ce72-47d3-a8eb-a229a7d29c46-delete_snapshot" released by "delete_snapshot" :: held 3.188s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:50 devstack sudo[94032]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5" returned: 0 in 0.592s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:50 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'} {{(pid=84195) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 06:50:50 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d56491-14d0-49ca-9bf4-e3dcfc66b24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5', 'volume_size': 1}' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc81253-2930-4a0e-8b06-838c67fe6426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 06:50:50 devstack cinder-volume[84195]: INFO cinder.volume.flows.manager.create_volume [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Volume volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5 (8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5): created successfully Apr 29 06:50:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc81253-2930-4a0e-8b06-838c67fe6426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84195) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 06:50:50 devstack cinder-volume[84195]: DEBUG cinder.volume.manager [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Flow 'volume_create_manager' (ce5e897f-a0e9-4353-a76c-8481358df9cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84195) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 06:50:50 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-0f4cae95-d717-4b98-8e99-c8eb27cdd545 tempest-CinderUnicodeTest-1897560203 None] Created volume successfully. Apr 29 06:50:50 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-0bbcb8dd-b0fe-45f0-8f54-1fa4f8e4756d tempest-SnapshotDependencyTests-1048922672 None] Acquiring lock "cinder-e6359c89-ba9b-46a2-b605-d9300aaadef7-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:50 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-0bbcb8dd-b0fe-45f0-8f54-1fa4f8e4756d tempest-SnapshotDependencyTests-1048922672 None] Lock "cinder-e6359c89-ba9b-46a2-b605-d9300aaadef7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:51 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-0bbcb8dd-b0fe-45f0-8f54-1fa4f8e4756d tempest-SnapshotDependencyTests-1048922672 None] Acquiring lock "cinder-quobyte-e6359c89-ba9b-46a2-b605-d9300aaadef7" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:51 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-0bbcb8dd-b0fe-45f0-8f54-1fa4f8e4756d tempest-SnapshotDependencyTests-1048922672 None] Lock "cinder-quobyte-e6359c89-ba9b-46a2-b605-d9300aaadef7" acquired by "delete_volume" :: waited 0.017s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:51 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4c22ae-a04e-4229-a31b-6fd66a2c4320]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0bbcb8dd-b0fe-45f0-8f54-1fa4f8e4756d tempest-SnapshotDependencyTests-1048922672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:51 devstack sudo[94035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7 Apr 29 06:50:51 devstack sudo[94035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-31b29dbc-861d-4ba9-ad4d-8b0102e1da52 tempest-CinderUnicodeTest-1897560203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-31b29dbc-861d-4ba9-ad4d-8b0102e1da52 tempest-CinderUnicodeTest-1897560203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:51 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-31b29dbc-861d-4ba9-ad4d-8b0102e1da52 tempest-CinderUnicodeTest-1897560203 None] Creating offline snapshot 52bd331c-11ee-40ff-9ada-7043e8890e08 of volume 8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5 {{(pid=84195) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 06:50:51 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ccff0b-d483-4b71-b64e-e552c1c7ffe3]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-31b29dbc-861d-4ba9-ad4d-8b0102e1da52 tempest-CinderUnicodeTest-1897560203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:51 devstack sudo[94037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5 Apr 29 06:50:51 devstack sudo[94037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:51 devstack sudo[94035]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0bbcb8dd-b0fe-45f0-8f54-1fa4f8e4756d tempest-SnapshotDependencyTests-1048922672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7" returned: 0 in 0.715s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:51 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0bbcb8dd-b0fe-45f0-8f54-1fa4f8e4756d tempest-SnapshotDependencyTests-1048922672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:51 devstack sudo[94042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7 Apr 29 06:50:51 devstack sudo[94042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:52 devstack sudo[94037]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-31b29dbc-861d-4ba9-ad4d-8b0102e1da52 tempest-CinderUnicodeTest-1897560203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5" returned: 0 in 0.707s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-31b29dbc-861d-4ba9-ad4d-8b0102e1da52 tempest-CinderUnicodeTest-1897560203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5.52bd331c-11ee-40ff-9ada-7043e8890e08 1G {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:52 devstack sudo[94047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5.52bd331c-11ee-40ff-9ada-7043e8890e08 1G Apr 29 06:50:52 devstack sudo[94047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:52 devstack sudo[94042]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0bbcb8dd-b0fe-45f0-8f54-1fa4f8e4756d tempest-SnapshotDependencyTests-1048922672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-e6359c89-ba9b-46a2-b605-d9300aaadef7" returned: 0 in 0.617s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:52 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-0bbcb8dd-b0fe-45f0-8f54-1fa4f8e4756d tempest-SnapshotDependencyTests-1048922672 None] Lock "cinder-quobyte-e6359c89-ba9b-46a2-b605-d9300aaadef7" released by "delete_volume" :: held 1.403s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:52 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-0bbcb8dd-b0fe-45f0-8f54-1fa4f8e4756d tempest-SnapshotDependencyTests-1048922672 None] Created reservations ['1e89d3ad-de46-4dc6-bd8b-72a0a740cd30', '4cdcb09d-8085-4b37-a138-1aab9ea90a34', '379efe94-bfe9-4360-bfe2-7d7fbd4daaf9', '18f6466c-fd6e-46dd-9bde-ec873df821e1'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:50:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-0bbcb8dd-b0fe-45f0-8f54-1fa4f8e4756d tempest-SnapshotDependencyTests-1048922672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-0bbcb8dd-b0fe-45f0-8f54-1fa4f8e4756d tempest-SnapshotDependencyTests-1048922672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:52 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-0bbcb8dd-b0fe-45f0-8f54-1fa4f8e4756d tempest-SnapshotDependencyTests-1048922672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:52 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-0bbcb8dd-b0fe-45f0-8f54-1fa4f8e4756d tempest-SnapshotDependencyTests-1048922672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-0bbcb8dd-b0fe-45f0-8f54-1fa4f8e4756d tempest-SnapshotDependencyTests-1048922672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0bbcb8dd-b0fe-45f0-8f54-1fa4f8e4756d tempest-SnapshotDependencyTests-1048922672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:52 devstack sudo[94052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:50:52 devstack sudo[94052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:52 devstack sudo[94047]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-31b29dbc-861d-4ba9-ad4d-8b0102e1da52 tempest-CinderUnicodeTest-1897560203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5.52bd331c-11ee-40ff-9ada-7043e8890e08 1G" returned: 0 in 0.761s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:52 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-31b29dbc-861d-4ba9-ad4d-8b0102e1da52 tempest-CinderUnicodeTest-1897560203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5.52bd331c-11ee-40ff-9ada-7043e8890e08 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:52 devstack sudo[94055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5.52bd331c-11ee-40ff-9ada-7043e8890e08 Apr 29 06:50:52 devstack sudo[94055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:53 devstack sudo[94052]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-0bbcb8dd-b0fe-45f0-8f54-1fa4f8e4756d tempest-SnapshotDependencyTests-1048922672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.592s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:53 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-0bbcb8dd-b0fe-45f0-8f54-1fa4f8e4756d tempest-SnapshotDependencyTests-1048922672 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:50:53 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-0bbcb8dd-b0fe-45f0-8f54-1fa4f8e4756d tempest-SnapshotDependencyTests-1048922672 None] Deleted volume successfully. Apr 29 06:50:53 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-0bbcb8dd-b0fe-45f0-8f54-1fa4f8e4756d tempest-SnapshotDependencyTests-1048922672 None] Lock "cinder-e6359c89-ba9b-46a2-b605-d9300aaadef7-delete_volume" released by "delete_volume" :: held 2.201s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:53 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-bc130fb9-bba7-49fe-b162-c4bc170a5699 tempest-SnapshotDependencyTests-1048922672 None] Acquiring lock "cinder-41b75d2f-e1cf-4099-a632-7df548895afa-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:53 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-bc130fb9-bba7-49fe-b162-c4bc170a5699 tempest-SnapshotDependencyTests-1048922672 None] Lock "cinder-41b75d2f-e1cf-4099-a632-7df548895afa-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:53 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-bc130fb9-bba7-49fe-b162-c4bc170a5699 tempest-SnapshotDependencyTests-1048922672 None] Acquiring lock "cinder-quobyte-41b75d2f-e1cf-4099-a632-7df548895afa" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:53 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-bc130fb9-bba7-49fe-b162-c4bc170a5699 tempest-SnapshotDependencyTests-1048922672 None] Lock "cinder-quobyte-41b75d2f-e1cf-4099-a632-7df548895afa" acquired by "delete_volume" :: waited 0.015s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:53 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[305f8755-9b9c-4e68-8eaa-4170f12ea896]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bc130fb9-bba7-49fe-b162-c4bc170a5699 tempest-SnapshotDependencyTests-1048922672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-41b75d2f-e1cf-4099-a632-7df548895afa {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:53 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-41b75d2f-e1cf-4099-a632-7df548895afa Apr 29 06:50:53 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:53 devstack sudo[94055]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-31b29dbc-861d-4ba9-ad4d-8b0102e1da52 tempest-CinderUnicodeTest-1897560203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5 -F qcow2 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5.52bd331c-11ee-40ff-9ada-7043e8890e08" returned: 0 in 0.687s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:53 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-31b29dbc-861d-4ba9-ad4d-8b0102e1da52 tempest-CinderUnicodeTest-1897560203 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5.52bd331c-11ee-40ff-9ada-7043e8890e08 is being set with open permissions: ugo+rw Apr 29 06:50:53 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-31b29dbc-861d-4ba9-ad4d-8b0102e1da52 tempest-CinderUnicodeTest-1897560203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5.52bd331c-11ee-40ff-9ada-7043e8890e08 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:53 devstack sudo[94063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5.52bd331c-11ee-40ff-9ada-7043e8890e08 Apr 29 06:50:53 devstack sudo[94063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:54 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bc130fb9-bba7-49fe-b162-c4bc170a5699 tempest-SnapshotDependencyTests-1048922672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-41b75d2f-e1cf-4099-a632-7df548895afa" returned: 0 in 0.743s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bc130fb9-bba7-49fe-b162-c4bc170a5699 tempest-SnapshotDependencyTests-1048922672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-41b75d2f-e1cf-4099-a632-7df548895afa {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:54 devstack sudo[94069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-41b75d2f-e1cf-4099-a632-7df548895afa Apr 29 06:50:54 devstack sudo[94069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:54 devstack sudo[94063]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-31b29dbc-861d-4ba9-ad4d-8b0102e1da52 tempest-CinderUnicodeTest-1897560203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5.52bd331c-11ee-40ff-9ada-7043e8890e08" returned: 0 in 0.610s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-31b29dbc-861d-4ba9-ad4d-8b0102e1da52 tempest-CinderUnicodeTest-1897560203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:54 devstack sudo[94071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5.info Apr 29 06:50:54 devstack sudo[94071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:54 devstack sudo[94069]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bc130fb9-bba7-49fe-b162-c4bc170a5699 tempest-SnapshotDependencyTests-1048922672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-41b75d2f-e1cf-4099-a632-7df548895afa" returned: 0 in 0.607s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:54 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-bc130fb9-bba7-49fe-b162-c4bc170a5699 tempest-SnapshotDependencyTests-1048922672 None] Lock "cinder-quobyte-41b75d2f-e1cf-4099-a632-7df548895afa" released by "delete_volume" :: held 1.391s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:54 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-bc130fb9-bba7-49fe-b162-c4bc170a5699 tempest-SnapshotDependencyTests-1048922672 None] Created reservations ['660f1b09-774f-422c-8f23-66d58b72f14b', '8b51381c-0b10-4811-a7f3-340af7a451c4', '4c519335-144a-44c6-8cfc-a270a9bb5c47', '16850004-4826-479a-b21b-a1b791e68b75'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:50:54 devstack sudo[94071]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-31b29dbc-861d-4ba9-ad4d-8b0102e1da52 tempest-CinderUnicodeTest-1897560203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5.info" returned: 0 in 0.609s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:54 devstack cinder-volume[84195]: WARNING cinder.volume.drivers.remotefs [None req-31b29dbc-861d-4ba9-ad4d-8b0102e1da52 tempest-CinderUnicodeTest-1897560203 None] /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5.info is being set with open permissions: ugo+rw Apr 29 06:50:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-31b29dbc-861d-4ba9-ad4d-8b0102e1da52 tempest-CinderUnicodeTest-1897560203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5.info {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-bc130fb9-bba7-49fe-b162-c4bc170a5699 tempest-SnapshotDependencyTests-1048922672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:50:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-bc130fb9-bba7-49fe-b162-c4bc170a5699 tempest-SnapshotDependencyTests-1048922672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:50:54 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-bc130fb9-bba7-49fe-b162-c4bc170a5699 tempest-SnapshotDependencyTests-1048922672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:50:54 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-bc130fb9-bba7-49fe-b162-c4bc170a5699 tempest-SnapshotDependencyTests-1048922672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:50:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-bc130fb9-bba7-49fe-b162-c4bc170a5699 tempest-SnapshotDependencyTests-1048922672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:54 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bc130fb9-bba7-49fe-b162-c4bc170a5699 tempest-SnapshotDependencyTests-1048922672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:54 devstack sudo[94075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5.info Apr 29 06:50:54 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:54 devstack sudo[94077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:50:54 devstack sudo[94077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:55 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-31b29dbc-861d-4ba9-ad4d-8b0102e1da52 tempest-CinderUnicodeTest-1897560203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5.info" returned: 0 in 0.587s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-31b29dbc-861d-4ba9-ad4d-8b0102e1da52 tempest-CinderUnicodeTest-1897560203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.068s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:50:55 devstack sudo[94077]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:55 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-bc130fb9-bba7-49fe-b162-c4bc170a5699 tempest-SnapshotDependencyTests-1048922672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.620s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:55 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-bc130fb9-bba7-49fe-b162-c4bc170a5699 tempest-SnapshotDependencyTests-1048922672 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:50:55 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-bc130fb9-bba7-49fe-b162-c4bc170a5699 tempest-SnapshotDependencyTests-1048922672 None] Deleted volume successfully. Apr 29 06:50:55 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-31b29dbc-861d-4ba9-ad4d-8b0102e1da52 tempest-CinderUnicodeTest-1897560203 None] Create snapshot completed successfully Apr 29 06:50:55 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-bc130fb9-bba7-49fe-b162-c4bc170a5699 tempest-SnapshotDependencyTests-1048922672 None] Lock "cinder-41b75d2f-e1cf-4099-a632-7df548895afa-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:56 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c0143279-6684-45c4-9cf4-031ee8a6e03f tempest-CinderUnicodeTest-1897560203 None] Acquiring lock "cinder-52bd331c-11ee-40ff-9ada-7043e8890e08-delete_snapshot" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:56 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c0143279-6684-45c4-9cf4-031ee8a6e03f tempest-CinderUnicodeTest-1897560203 None] Lock "cinder-52bd331c-11ee-40ff-9ada-7043e8890e08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:56 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c0143279-6684-45c4-9cf4-031ee8a6e03f tempest-CinderUnicodeTest-1897560203 None] Acquiring lock "cinder-quobyte-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5" by "delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:56 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c0143279-6684-45c4-9cf4-031ee8a6e03f tempest-CinderUnicodeTest-1897560203 None] Lock "cinder-quobyte-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:56 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c0143279-6684-45c4-9cf4-031ee8a6e03f tempest-CinderUnicodeTest-1897560203 None] Acquiring lock "cinder-quobyte-52bd331c-11ee-40ff-9ada-7043e8890e08" by "_delete_snapshot" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:50:56 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c0143279-6684-45c4-9cf4-031ee8a6e03f tempest-CinderUnicodeTest-1897560203 None] Lock "cinder-quobyte-52bd331c-11ee-40ff-9ada-7043e8890e08" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:50:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-c0143279-6684-45c4-9cf4-031ee8a6e03f tempest-CinderUnicodeTest-1897560203 None] Deleting offline snapshot 52bd331c-11ee-40ff-9ada-7043e8890e08 of volume 8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 06:50:56 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-c0143279-6684-45c4-9cf4-031ee8a6e03f tempest-CinderUnicodeTest-1897560203 None] snapshot_file for this snap is: volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5.52bd331c-11ee-40ff-9ada-7043e8890e08 {{(pid=84195) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 06:50:56 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7b4629-a715-4ba6-88d5-4a5b6303febe]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:56 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c0143279-6684-45c4-9cf4-031ee8a6e03f tempest-CinderUnicodeTest-1897560203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5.52bd331c-11ee-40ff-9ada-7043e8890e08 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:56 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5.52bd331c-11ee-40ff-9ada-7043e8890e08 Apr 29 06:50:56 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:57 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c0143279-6684-45c4-9cf4-031ee8a6e03f tempest-CinderUnicodeTest-1897560203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5.52bd331c-11ee-40ff-9ada-7043e8890e08" returned: 0 in 0.732s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:57 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.remotefs [None req-c0143279-6684-45c4-9cf4-031ee8a6e03f tempest-CinderUnicodeTest-1897560203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84195) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 06:50:57 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddcdb07-0cbf-4276-acd6-572970df1c1c]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:50:57 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c0143279-6684-45c4-9cf4-031ee8a6e03f tempest-CinderUnicodeTest-1897560203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:57 devstack sudo[94088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5 Apr 29 06:50:57 devstack sudo[94088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:58 devstack sudo[94088]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c0143279-6684-45c4-9cf4-031ee8a6e03f tempest-CinderUnicodeTest-1897560203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5" returned: 0 in 0.813s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c0143279-6684-45c4-9cf4-031ee8a6e03f tempest-CinderUnicodeTest-1897560203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5.52bd331c-11ee-40ff-9ada-7043e8890e08 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:58 devstack sudo[94093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5.52bd331c-11ee-40ff-9ada-7043e8890e08 Apr 29 06:50:58 devstack sudo[94093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:58 devstack sudo[94093]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c0143279-6684-45c4-9cf4-031ee8a6e03f tempest-CinderUnicodeTest-1897560203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5.52bd331c-11ee-40ff-9ada-7043e8890e08" returned: 0 in 0.759s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:58 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c0143279-6684-45c4-9cf4-031ee8a6e03f tempest-CinderUnicodeTest-1897560203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5.52bd331c-11ee-40ff-9ada-7043e8890e08 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:50:58 devstack sudo[94100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5.52bd331c-11ee-40ff-9ada-7043e8890e08 Apr 29 06:50:58 devstack sudo[94100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:50:59 devstack sudo[94100]: pam_unix(sudo:session): session closed for user root Apr 29 06:50:59 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-c0143279-6684-45c4-9cf4-031ee8a6e03f tempest-CinderUnicodeTest-1897560203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5.52bd331c-11ee-40ff-9ada-7043e8890e08" returned: 0 in 0.639s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:50:59 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:UPDATE=205,cinder:DELETE=23,cinder:SELECT=154,cinder:INSERT=56 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:50:59 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c0143279-6684-45c4-9cf4-031ee8a6e03f tempest-CinderUnicodeTest-1897560203 None] Lock "cinder-quobyte-52bd331c-11ee-40ff-9ada-7043e8890e08" released by "_delete_snapshot" :: held 3.060s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:59 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c0143279-6684-45c4-9cf4-031ee8a6e03f tempest-CinderUnicodeTest-1897560203 None] Lock "cinder-quobyte-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5" released by "delete_snapshot" :: held 3.090s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:50:59 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-c0143279-6684-45c4-9cf4-031ee8a6e03f tempest-CinderUnicodeTest-1897560203 None] Created reservations ['4a3eb292-be81-4fa6-92d5-d80aec9910ef', '55c83469-3820-4e3f-8030-9a1cfc764dee', '05ede6ab-ab73-4a31-8ffd-6c8264696b03', '75e2fac8-6bb6-44d1-a5f2-dc333606ff86'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:50:59 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-c0143279-6684-45c4-9cf4-031ee8a6e03f tempest-CinderUnicodeTest-1897560203 None] Delete snapshot completed successfully. Apr 29 06:50:59 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-c0143279-6684-45c4-9cf4-031ee8a6e03f tempest-CinderUnicodeTest-1897560203 None] Lock "cinder-52bd331c-11ee-40ff-9ada-7043e8890e08-delete_snapshot" released by "delete_snapshot" :: held 3.231s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:51:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-dfefb914-7673-4bad-9049-a241fb2d4a8e tempest-CinderUnicodeTest-1897560203 None] Acquiring lock "cinder-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:51:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-dfefb914-7673-4bad-9049-a241fb2d4a8e tempest-CinderUnicodeTest-1897560203 None] Lock "cinder-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:51:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-dfefb914-7673-4bad-9049-a241fb2d4a8e tempest-CinderUnicodeTest-1897560203 None] Acquiring lock "cinder-quobyte-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:51:00 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-dfefb914-7673-4bad-9049-a241fb2d4a8e tempest-CinderUnicodeTest-1897560203 None] Lock "cinder-quobyte-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5" acquired by "delete_volume" :: waited 0.017s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:51:00 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df21711-03d8-4a6e-9975-1560911840a9]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:51:00 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dfefb914-7673-4bad-9049-a241fb2d4a8e tempest-CinderUnicodeTest-1897560203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:51:01 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5 Apr 29 06:51:01 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:51:01 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Apr 29 06:51:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dfefb914-7673-4bad-9049-a241fb2d4a8e tempest-CinderUnicodeTest-1897560203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5" returned: 0 in 0.792s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:51:01 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dfefb914-7673-4bad-9049-a241fb2d4a8e tempest-CinderUnicodeTest-1897560203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5 {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:51:01 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5 Apr 29 06:51:01 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:51:02 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Apr 29 06:51:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dfefb914-7673-4bad-9049-a241fb2d4a8e tempest-CinderUnicodeTest-1897560203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5" returned: 0 in 0.664s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:51:02 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-dfefb914-7673-4bad-9049-a241fb2d4a8e tempest-CinderUnicodeTest-1897560203 None] Lock "cinder-quobyte-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5" released by "delete_volume" :: held 1.518s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:51:02 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-dfefb914-7673-4bad-9049-a241fb2d4a8e tempest-CinderUnicodeTest-1897560203 None] Created reservations ['19654260-799b-4198-8251-b4079867dbd2', 'c81d659b-b324-4ec4-95ac-89d9a371031a', 'bf685c0c-1696-49e0-a80a-60b8353885c6', 'b3260cd5-792c-4b82-91b7-0a2f790be2b2'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:51:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-dfefb914-7673-4bad-9049-a241fb2d4a8e tempest-CinderUnicodeTest-1897560203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:51:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-dfefb914-7673-4bad-9049-a241fb2d4a8e tempest-CinderUnicodeTest-1897560203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:51:02 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-dfefb914-7673-4bad-9049-a241fb2d4a8e tempest-CinderUnicodeTest-1897560203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:51:02 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-dfefb914-7673-4bad-9049-a241fb2d4a8e tempest-CinderUnicodeTest-1897560203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:51:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-dfefb914-7673-4bad-9049-a241fb2d4a8e tempest-CinderUnicodeTest-1897560203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:51:02 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dfefb914-7673-4bad-9049-a241fb2d4a8e tempest-CinderUnicodeTest-1897560203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:51:02 devstack sudo[94112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:51:02 devstack sudo[94112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:51:03 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93616b22-6e85-4fcf-9060-f918c83b1e89 tempest-CinderUnicodeTest-1897560203 None] Acquiring lock "cinder-53a9cb54-33d1-4a64-b792-837217eb267c-delete_volume" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:51:03 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93616b22-6e85-4fcf-9060-f918c83b1e89 tempest-CinderUnicodeTest-1897560203 None] Lock "cinder-53a9cb54-33d1-4a64-b792-837217eb267c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:51:03 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93616b22-6e85-4fcf-9060-f918c83b1e89 tempest-CinderUnicodeTest-1897560203 None] Acquiring lock "cinder-quobyte-53a9cb54-33d1-4a64-b792-837217eb267c" by "delete_volume" {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 06:51:03 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93616b22-6e85-4fcf-9060-f918c83b1e89 tempest-CinderUnicodeTest-1897560203 None] Lock "cinder-quobyte-53a9cb54-33d1-4a64-b792-837217eb267c" acquired by "delete_volume" :: waited 0.020s {{(pid=84195) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 06:51:03 devstack cinder-volume[84195]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bdd005-1c3d-4a8b-b819-4cfa3dd20a3a]: (4, 'qcow2') {{(pid=85218) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 06:51:03 devstack sudo[94112]: pam_unix(sudo:session): session closed for user root Apr 29 06:51:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93616b22-6e85-4fcf-9060-f918c83b1e89 tempest-CinderUnicodeTest-1897560203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-53a9cb54-33d1-4a64-b792-837217eb267c {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:51:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-dfefb914-7673-4bad-9049-a241fb2d4a8e tempest-CinderUnicodeTest-1897560203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.678s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:51:03 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-dfefb914-7673-4bad-9049-a241fb2d4a8e tempest-CinderUnicodeTest-1897560203 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:51:03 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-dfefb914-7673-4bad-9049-a241fb2d4a8e tempest-CinderUnicodeTest-1897560203 None] Deleted volume successfully. Apr 29 06:51:03 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-dfefb914-7673-4bad-9049-a241fb2d4a8e tempest-CinderUnicodeTest-1897560203 None] Lock "cinder-8a90cd9c-e9fb-4cc3-94d6-de1a3e24d0d5-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:51:03 devstack sudo[94116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-53a9cb54-33d1-4a64-b792-837217eb267c Apr 29 06:51:03 devstack sudo[94116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:51:03 devstack sudo[94116]: pam_unix(sudo:session): session closed for user root Apr 29 06:51:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93616b22-6e85-4fcf-9060-f918c83b1e89 tempest-CinderUnicodeTest-1897560203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-53a9cb54-33d1-4a64-b792-837217eb267c" returned: 0 in 0.749s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:51:03 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93616b22-6e85-4fcf-9060-f918c83b1e89 tempest-CinderUnicodeTest-1897560203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-53a9cb54-33d1-4a64-b792-837217eb267c {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:51:03 devstack sudo[94121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-53a9cb54-33d1-4a64-b792-837217eb267c Apr 29 06:51:03 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:51:04 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root Apr 29 06:51:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93616b22-6e85-4fcf-9060-f918c83b1e89 tempest-CinderUnicodeTest-1897560203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae/volume-53a9cb54-33d1-4a64-b792-837217eb267c" returned: 0 in 0.609s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:51:04 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93616b22-6e85-4fcf-9060-f918c83b1e89 tempest-CinderUnicodeTest-1897560203 None] Lock "cinder-quobyte-53a9cb54-33d1-4a64-b792-837217eb267c" released by "delete_volume" :: held 1.416s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:51:04 devstack cinder-volume[84195]: DEBUG cinder.quota [None req-93616b22-6e85-4fcf-9060-f918c83b1e89 tempest-CinderUnicodeTest-1897560203 None] Created reservations ['3d72a687-e4a8-4922-9565-a5c8b5e9f161', '063f55fb-8912-4f62-a29c-b7fdb34d1eb5', '6cfb26d7-db2e-4db8-8ed8-019e9d1a99c1', 'b98ff46f-a42e-4105-a5ba-3ec73f3a2275'] {{(pid=84195) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 06:51:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-93616b22-6e85-4fcf-9060-f918c83b1e89 tempest-CinderUnicodeTest-1897560203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 06:51:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-93616b22-6e85-4fcf-9060-f918c83b1e89 tempest-CinderUnicodeTest-1897560203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 06:51:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-93616b22-6e85-4fcf-9060-f918c83b1e89 tempest-CinderUnicodeTest-1897560203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9': None} {{(pid=84195) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 06:51:04 devstack cinder-volume[84195]: DEBUG cinder.volume.drivers.quobyte [None req-93616b22-6e85-4fcf-9060-f918c83b1e89 tempest-CinderUnicodeTest-1897560203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4354e4e7-8926-4b11-8854-86706162dcc9'] {{(pid=84195) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 06:51:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.lockutils [None req-93616b22-6e85-4fcf-9060-f918c83b1e89 tempest-CinderUnicodeTest-1897560203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84195) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 06:51:04 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93616b22-6e85-4fcf-9060-f918c83b1e89 tempest-CinderUnicodeTest-1897560203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 06:51:04 devstack sudo[94124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae Apr 29 06:51:04 devstack sudo[94124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 06:51:05 devstack sudo[94124]: pam_unix(sudo:session): session closed for user root Apr 29 06:51:05 devstack cinder-volume[84195]: DEBUG oslo_concurrency.processutils [None req-93616b22-6e85-4fcf-9060-f918c83b1e89 tempest-CinderUnicodeTest-1897560203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d69ba4ae9ca632a57e356976f7819cae" returned: 0 in 0.586s {{(pid=84195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 06:51:05 devstack cinder-volume[84195]: DEBUG cinder.manager [None req-93616b22-6e85-4fcf-9060-f918c83b1e89 tempest-CinderUnicodeTest-1897560203 None] Notifying Schedulers of capabilities ... {{(pid=84195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 06:51:05 devstack cinder-volume[84195]: INFO cinder.volume.manager [None req-93616b22-6e85-4fcf-9060-f918c83b1e89 tempest-CinderUnicodeTest-1897560203 None] Deleted volume successfully. Apr 29 06:51:05 devstack cinder-volume[84195]: DEBUG cinder.coordination [None req-93616b22-6e85-4fcf-9060-f918c83b1e89 tempest-CinderUnicodeTest-1897560203 None] Lock "cinder-53a9cb54-33d1-4a64-b792-837217eb267c-delete_volume" released by "delete_volume" :: held 2.229s {{(pid=84195) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 06:51:14 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:SELECT=17,cinder:INSERT=8,cinder:UPDATE=20 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 06:51:15 devstack cinder-volume[84195]: DEBUG dbcounter [-] [84195] Writing DB stats cinder:SELECT=127,cinder:INSERT=47,cinder:UPDATE=213,cinder:DELETE=14 {{(pid=84195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}